-- Logs begin at Sat 2022-10-01 03:38:53 UTC, end at Sat 2022-10-01 04:37:37 UTC. -- Oct 01 04:09:18.161660 dv-cinder-860044-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 01 04:09:18.170442 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 01 04:09:18.172418 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 1 04:09:18 2022] *** Oct 01 04:09:18.172418 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 01 04:09:18.172418 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 01 04:09:18.172418 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: nodename: dv-cinder-860044-1-iscsi Oct 01 04:09:18.172418 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: machine: x86_64 Oct 01 04:09:18.172418 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: clock source: unix Oct 01 04:09:18.172418 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: pcre jit disabled Oct 01 04:09:18.172418 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: detected number of CPU cores: 4 Oct 01 04:09:18.172418 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: current working directory: / Oct 01 04:09:18.172418 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: detected binary path: /usr/bin/uwsgi-core Oct 01 04:09:18.173232 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: your processes number limit is 47680 Oct 01 04:09:18.173232 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: your memory page size is 4096 bytes Oct 01 04:09:18.173232 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: detected max file descriptor number: 2048 Oct 01 04:09:18.173232 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: lock engine: pthread robust mutexes Oct 01 04:09:18.173232 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: thunder lock: enabled Oct 01 04:09:18.173232 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 01 04:09:18.173232 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 01 04:09:18.211404 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: Python main interpreter initialized at 0x55c7ea65c9c0 Oct 01 04:09:18.211404 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: python threads support enabled Oct 01 04:09:18.211404 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: your server socket listen backlog is limited to 100 connections Oct 01 04:09:18.211404 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: your mercy for graceful operations on workers is 90 seconds Oct 01 04:09:18.211747 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: mapped 403077 bytes (393 KB) for 2 cores Oct 01 04:09:18.211830 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: *** Operational MODE: preforking *** Oct 01 04:09:18.212055 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: *** uWSGI is running in multiple interpreter mode *** Oct 01 04:09:18.212055 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: spawned uWSGI master process (pid: 105603) Oct 01 04:09:18.212244 dv-cinder-860044-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 01 04:09:18.216977 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: spawned uWSGI worker 1 (pid: 105604, cores: 1) Oct 01 04:09:18.216977 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: spawned uWSGI worker 2 (pid: 105605, cores: 1) Oct 01 04:09:18.216977 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 01 04:09:18.882506 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 01 04:09:18.883085 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 01 04:09:19.985874 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 01 04:09:19.985874 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: from cryptography.utils import int_from_bytes Oct 01 04:09:19.986579 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 01 04:09:19.986579 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: from cryptography.utils import int_from_bytes Oct 01 04:09:19.988206 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 01 04:09:19.988206 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: from cryptography.utils import int_from_bytes Oct 01 04:09:19.988647 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 01 04:09:19.988647 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: from cryptography.utils import int_from_bytes Oct 01 04:09:22.494979 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 01 04:09:22.495677 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 01 04:09:22.496023 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 01 04:09:22.496118 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 01 04:09:22.496199 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 01 04:09:22.496289 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 01 04:09:22.496385 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 01 04:09:22.496471 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 01 04:09:22.496556 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 01 04:09:22.496635 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 01 04:09:22.496828 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.496951 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.497175 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.497263 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.497498 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.497590 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.497815 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.497910 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.498147 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.498233 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.498456 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.498549 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.498775 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.498865 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.499090 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.499173 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.499412 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.499502 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.499670 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.499754 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.499984 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.500132 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.500304 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860044-1-iscsi {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.500414 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860044-1-iscsi {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.500619 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.500703 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.500940 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.501100 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.501235 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.501372 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.501548 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.501672 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.501857 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.501970 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.502173 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.502298 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.502474 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.502586 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.502965 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.503096 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.504299 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.504299 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.504679 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.504831 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.505019 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.505019 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.505400 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.505400 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.505772 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.505962 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.506110 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.506110 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.506494 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.506494 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.506849 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.506849 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.507171 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.507171 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.507486 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.507486 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.507677 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860044-1-iscsi {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.507677 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.507823 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860044-1-iscsi {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.507899 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.507974 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.508103 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.508192 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.508270 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.508392 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.508494 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.508582 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.508666 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.508789 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.508870 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.508960 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.509051 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.509184 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.509309 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.509451 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.509634 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.509756 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.509952 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.510141 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.510274 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.510657 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.511032 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.511344 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.511612 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.511718 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.511960 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.512054 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.512266 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.512369 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.512570 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.512681 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.512822 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.512947 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.513150 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.513255 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.513470 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.513557 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.513791 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.513885 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.514113 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.514209 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.514363 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.514449 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.514611 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.514705 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.514932 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.515025 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.515254 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.515360 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.515569 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.515673 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.515870 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.515963 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.516116 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.516265 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.516443 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.516546 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.516766 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.516866 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.517100 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.517194 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.517411 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.517497 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.517703 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.517809 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.518009 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.518120 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.518316 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.518412 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.518620 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.518716 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.518920 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.519021 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.519223 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.519325 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.519541 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.519634 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.520299 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.520514 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.520607 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.520688 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.520763 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.520831 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.520907 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.521133 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.521133 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.521272 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.521390 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.521555 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.521691 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.521784 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.522018 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.522111 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.522325 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.522411 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.522626 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.522720 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.522941 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.523032 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.523254 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.523339 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.523554 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.523644 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.523805 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.523890 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.524104 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.524201 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.524405 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.524499 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.524723 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.524808 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.525048 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.525213 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.525298 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.525375 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.525581 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.525666 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.525881 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.525975 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.526757 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.526884 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.527060 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.527190 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.527365 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.527496 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.527668 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.527798 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.527972 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.528096 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.528276 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.528400 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.528577 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.528701 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.529152 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.529279 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.529455 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.529582 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.529757 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.529882 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.530075 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.530181 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.530395 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.530490 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.530699 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.530794 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.531000 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.531095 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.531308 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.531432 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.531612 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.531714 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.531930 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.532024 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.532226 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.532318 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.532526 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.532628 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.532827 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.532921 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.533154 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.533255 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.533456 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.533548 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.533761 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.533853 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.534059 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.534152 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.534360 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.534460 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.534659 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.534752 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.534957 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.535050 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.535258 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.535349 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.535556 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.535647 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.535855 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.535947 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.536160 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.536251 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.536452 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.536553 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.536749 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.536843 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.537071 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.537179 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.537376 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.537478 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.537673 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.537764 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.537971 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.538064 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.538267 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.538380 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.538560 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.538647 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.538857 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.538945 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.539154 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.539252 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.539453 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.539539 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.539746 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.539832 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.540056 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.540142 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.540370 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.540494 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.540671 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.540756 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.540992 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.541081 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.541295 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.541393 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.541704 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:09:22.542319 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.542550 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.542639 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.542881 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.542969 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.543221 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.543315 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.543531 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.543616 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.543860 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.543945 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.544169 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.544262 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.544477 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.544562 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.544786 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.544871 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.545123 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.545291 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.545446 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.545537 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.545751 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.545836 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.546061 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.546159 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.546367 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.546459 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.546678 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.546774 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.546987 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.547080 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.547303 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.547388 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.547614 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.547704 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.547927 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.548025 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.548235 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.548319 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.548540 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.548627 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.548855 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.548976 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.549208 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.549305 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.549523 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.549609 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.549833 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.549919 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.550140 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.550223 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.550449 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.550534 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.550760 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.550849 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.551102 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.551197 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.551410 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.551500 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.551714 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.551799 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.552020 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.552113 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.552328 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.552411 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.552649 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.552736 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.552976 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.553077 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.553287 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.553381 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.553595 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.553681 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.553900 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.553991 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.554206 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.554298 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.554513 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.554596 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.554818 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.554915 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.555124 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.555219 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.555429 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.555514 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.555733 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.555825 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.556044 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.556135 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.556353 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.556440 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.556662 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.556747 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.556988 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.557077 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.557352 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.557448 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.557666 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.557812 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.557973 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.558122 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.558277 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.558429 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.558582 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.558735 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.558884 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.559053 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.559185 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.559382 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.559469 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.559689 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.559787 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.560026 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.560147 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.560331 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.560431 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.560656 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.560795 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.560965 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.561058 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.561279 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.561375 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.561585 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.561679 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.561888 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.561975 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.562192 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.562278 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.562495 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.562587 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.562793 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.562876 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.563100 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.563185 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.563403 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.563488 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.563702 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.563785 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.564013 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.564108 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.564313 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.564397 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.564613 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.564699 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.564919 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.565033 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.565242 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.565326 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.565543 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.565628 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.565851 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.565948 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.566158 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.566243 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.566461 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.566547 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.566767 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.566860 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.567068 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.567159 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.567388 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.567473 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.567695 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.567790 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.568000 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.568091 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.568323 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.568414 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.568639 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.568724 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.568974 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.569061 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.569261 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.569345 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.569564 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.569651 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.569866 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.569959 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.570169 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.570254 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.570471 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.570556 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.570830 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.570928 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.571064 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.571158 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.571363 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.571447 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.571663 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.571749 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.571963 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.572061 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.572263 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.572350 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.572563 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.572648 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.572862 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.573482 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.573726 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.574220 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.574367 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.574529 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.574835 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.574996 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.575135 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.575448 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.575594 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.575940 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.576040 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.576328 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.576550 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.576822 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.577237 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.577589 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.577782 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.577949 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.578289 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.578449 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.578625 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.578822 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.578981 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.579177 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.579275 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.579386 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.579584 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.579730 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.579912 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.580068 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.580240 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.580545 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.580632 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.580967 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.581155 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.581244 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.581558 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.581729 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.581886 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.582137 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.582289 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.582474 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.582626 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.582804 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.582941 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.583144 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.583231 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.583468 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.583553 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.583798 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.583883 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.584115 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.584208 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.584434 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.584519 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.584757 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.584849 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.585116 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.585204 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.585436 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.585521 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.585756 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.585860 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.586070 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.586154 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.586392 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.586477 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.586706 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.586800 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.587017 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.587101 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.587331 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.587423 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.587643 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.587737 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.587969 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.588190 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.588281 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.588583 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.589220 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.589431 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.589532 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.589748 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.589873 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.590079 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.590219 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.590394 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.590538 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.590716 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.590857 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.591029 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.591194 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.591345 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.591511 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.591678 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.591831 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.592016 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.592150 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.592328 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.592461 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.592640 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.592773 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.592981 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.593121 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.593298 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.593445 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.593611 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.593763 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.593923 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.594082 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.594229 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.594398 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.594535 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.594719 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.594845 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.595037 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.595158 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.595349 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.595469 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.595659 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.595778 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.595976 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.596083 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.596307 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.596392 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.596628 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.596723 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.596978 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.597068 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.597304 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.597388 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.597614 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.597710 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.597925 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.598012 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.598233 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.598319 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.598556 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.598643 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.598865 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.598949 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.599172 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.599256 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.599478 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.599565 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.599801 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.599892 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.600112 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.600196 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.600417 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.600512 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.600721 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.600807 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.601046 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.601148 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.601380 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.601477 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.601684 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.601776 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.601986 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.602079 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.602298 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.602382 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.602614 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.602704 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.602922 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.603015 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.603233 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.603317 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.603538 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.603622 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.603845 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.603939 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.604195 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.604280 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.604661 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.604753 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.605089 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.605237 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.605409 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.605561 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.605727 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.605878 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.606041 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.606191 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.606352 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.606508 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.606672 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.606834 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.606993 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.607145 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.607456 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.607695 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.607788 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.608052 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.608144 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.608358 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.608441 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.608677 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.608763 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.609063 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.609278 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.609377 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.609613 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.609720 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.609930 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.610058 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.610250 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.610377 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.610591 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.610684 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.610910 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.610996 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.611243 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.611335 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.611575 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.611672 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.611886 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.611972 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.612192 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.612284 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.612499 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.612583 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.612804 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.612888 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.613134 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.613232 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.613445 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.613537 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.613749 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.613833 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.614053 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.614151 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.614358 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.614451 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.614667 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.614752 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.614970 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.615064 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.615271 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.615364 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.615578 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.615661 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.615881 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.615974 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.616193 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.616286 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.616502 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.616587 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.616807 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.616892 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.617135 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.617222 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.617460 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.617546 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.617771 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.617857 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.618075 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.618161 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.618379 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.618465 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.618681 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.618767 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.619023 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.619109 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.619325 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.619419 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.619663 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.619750 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.620093 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.620188 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.620470 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.620574 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.620782 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.620868 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.621118 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.621219 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.621433 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.621526 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.621739 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.621827 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.622046 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.622133 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.622351 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.622446 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.622660 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.622749 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.622967 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.623052 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.623270 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.623365 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.623580 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.623677 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.623886 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.623971 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.624195 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.624281 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.624502 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.624596 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.624802 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.624888 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.625135 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.625268 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.625437 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.625522 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.625750 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.625841 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.626057 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.626149 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.626361 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.626446 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.626669 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.626762 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.626977 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.627063 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.627299 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.627385 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.627583 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.627676 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.627888 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.627979 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.628187 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.628271 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.628499 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.628591 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.628808 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.628893 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.629127 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.629214 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.629430 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.629564 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.629738 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.629834 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.630046 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.630131 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.630346 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.630439 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.630654 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.630746 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.630960 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.631046 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.631261 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.631347 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.631565 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.631651 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.631873 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.631995 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.632177 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.632264 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.632477 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.632574 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.632784 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.632871 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.633122 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.633210 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.633433 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.633519 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.633735 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.633828 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.634041 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.634127 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.634341 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.634425 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.634644 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.634741 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.634947 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.635033 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.635253 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.635338 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.636085 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.636187 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.636390 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.636584 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.636695 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.636910 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.637093 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.637248 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.637335 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.637558 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.637644 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.637911 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.638004 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.638215 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.638301 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.638520 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.638605 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.638823 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.638918 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.639166 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.639253 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.639470 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.639556 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.639799 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.639891 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.640116 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.640202 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.640426 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.640547 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.640733 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.640829 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.641068 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.641158 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.641379 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.641477 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.641692 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.641792 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.642000 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.642091 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.642309 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.642395 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.642618 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.642710 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.642933 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.643018 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.643237 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.643323 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.643540 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.643627 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.643863 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.643948 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.644175 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.644261 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.644487 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.644572 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.644801 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.644886 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.645144 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.645241 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.645461 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.645548 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.645762 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.645846 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.646070 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.646155 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.646381 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.646467 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.646687 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.646770 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.647002 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.647095 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.647311 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.647395 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.647619 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.647710 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.647926 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.648020 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.648234 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.648320 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.648543 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.648637 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.648849 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.648973 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.649181 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.649265 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.649491 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.649587 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.649800 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.649931 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.650103 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.650196 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.650407 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.650492 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.650720 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.650814 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.651068 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.651659 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.651885 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.652159 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.652359 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.652479 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.652674 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.652797 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.653000 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.653137 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.653438 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.653526 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.653750 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.653848 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.654316 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.654409 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.654621 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.654715 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.654929 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.655020 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.655235 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.655393 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.655550 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.655657 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.655863 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.655972 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.656167 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.656287 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.656584 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.656678 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.656895 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.657022 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.657233 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.657334 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.657538 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.657675 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.657845 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.657931 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.658150 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.658243 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.658457 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.658541 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.658780 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.658864 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.659083 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.659168 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.659387 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.659479 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.659690 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.659814 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.660013 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.660135 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.660317 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.660405 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.660638 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.660826 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.661076 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.661166 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.661387 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.661472 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.661691 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.661776 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.662092 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.662198 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.662407 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.662492 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.662715 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.662808 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.663030 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.663121 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.663343 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.663431 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.663665 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.663750 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.663969 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.664062 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.664283 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.664369 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.664591 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.664676 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.664897 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.665015 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.665249 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.665336 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.665557 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.665642 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.665871 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.666032 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.666176 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.666262 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.666500 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.666606 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.666975 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.667081 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.667288 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.667374 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.667614 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.667739 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.667944 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.668031 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.668257 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.668342 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.668565 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.668658 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.668880 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.669001 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.669216 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.669302 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.669525 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.669611 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.669853 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.669941 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.670163 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.670285 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.670466 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.670550 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.670771 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.670893 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.671080 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.671164 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.671385 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.671483 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.671690 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.671775 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.671995 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.672092 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.672303 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.672400 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.672607 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.672706 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.672911 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.673059 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.673255 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.673355 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.673561 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.673647 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.673882 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.673969 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.674198 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.674292 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.674510 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.674594 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.674821 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.674908 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.675127 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.675212 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.675434 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.675518 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.675744 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.675830 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.676049 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.676141 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.676352 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.676451 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.676657 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.676744 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.677025 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.677115 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.677337 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.677423 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.677657 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.677754 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.677988 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.678075 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.678309 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.678393 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.678617 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.678709 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.678938 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.679030 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.679261 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.679345 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.679569 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.679661 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.679874 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.679966 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.680185 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.680269 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.680492 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.680594 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.680798 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.680883 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.681123 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.681224 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.681431 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.681518 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.681734 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.681819 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.682034 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.682119 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.682376 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.682462 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.682706 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.682792 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.683013 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.683147 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.683339 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.683453 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.683651 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.683743 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.683957 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.684069 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.684262 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.684374 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.684567 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.684696 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.684912 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.685068 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.685243 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.685337 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.685575 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.685668 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.685886 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.685978 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.686213 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.686299 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.686515 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.686600 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.686840 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.686934 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.687153 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.687239 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.687468 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.687553 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.687780 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.687872 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.688093 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.688178 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.688409 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.688493 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.688719 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.688812 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.689058 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.689147 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.689375 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.689464 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.689691 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.689778 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.690001 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.690237 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.690372 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.690569 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.690664 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.690887 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.690973 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.691204 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.691443 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.691530 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.691772 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.691859 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.692085 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.692171 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.692395 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.692490 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.692708 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.692794 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.693042 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.693130 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.693355 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.693451 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.693666 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.693753 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.693975 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.694067 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.694283 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.694378 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.694591 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.694677 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.694918 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.695010 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.695235 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.695340 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.695553 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.695644 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.695866 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.695965 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.696182 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.696268 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.696494 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.696580 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.696805 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.696900 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.697145 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.697234 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.697459 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.697555 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.697777 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.698364 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.698637 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.698742 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.698954 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.699049 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.699272 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.699367 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.699590 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.699686 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.699905 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.699992 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.700217 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.700305 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.700532 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.700630 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.700842 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.700955 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.701178 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.701267 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.701489 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.701583 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.701801 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.701887 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.702113 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.702200 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.702434 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.702576 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.702750 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.702844 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.703073 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.703278 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.703384 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.703603 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.703689 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.703946 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.704040 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.704281 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.704504 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.704613 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.704817 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.704919 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.705174 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.705263 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.705502 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.705598 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.705828 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.705915 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.706146 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.706233 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.706463 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.706550 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.706779 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.706865 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.707082 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.707169 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.707386 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.707479 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.707697 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.707784 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.708002 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.708095 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.708305 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.708390 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.708625 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.708720 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.708976 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.709257 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.709356 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.709574 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.709661 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.709881 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.709974 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.710243 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.710416 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.710573 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.710769 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.710896 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.711089 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.711208 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.711421 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.711536 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.711751 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.711837 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.712072 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.712166 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.712383 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.712481 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.712710 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.712803 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.713047 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.713136 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.713357 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.713445 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.714213 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.714298 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.714528 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.714720 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.714834 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.715041 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.715127 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.715364 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.715450 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.715680 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.715775 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.716018 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.716104 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.716324 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.716410 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.716628 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.716722 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.716964 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.717053 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.717269 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.717353 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.717581 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.717669 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.717887 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.717981 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.718197 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.718282 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.718498 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.718583 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.718803 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.718889 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.719106 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.719192 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.719411 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.719497 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.719717 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.719802 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.720019 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.720103 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.720326 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.720412 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.720630 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.720715 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.720950 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.721050 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.721311 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.721396 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.721621 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.721706 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.721924 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.722016 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.722243 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.722327 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.722546 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.722631 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.722850 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.722950 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.723162 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.723254 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.723469 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.723556 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.723792 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.723885 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.724103 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.724189 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.724411 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.724649 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.724743 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.725014 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.725103 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.725341 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.725617 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.725714 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.725953 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.726042 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.726273 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.726360 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.726590 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.726675 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.726901 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.726988 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.727213 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.727304 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.727524 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.727609 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.727829 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.727922 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.728139 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.728224 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.728450 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.728543 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.728761 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.728845 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.729093 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.729199 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.729425 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.729523 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.729736 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.729841 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.730041 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.730128 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.730350 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.730446 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.730657 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.730791 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.730964 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.731051 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.731270 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.731365 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.731576 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.731662 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.731882 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.731968 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.732188 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.732275 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.732494 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.732590 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.732805 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.732891 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.733203 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.733326 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.733472 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.733563 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.733784 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.733877 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.734092 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.734178 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.734403 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.734488 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.734717 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.734812 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.735036 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.735122 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.735370 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.735458 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.735689 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.735792 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.736001 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.736087 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.736329 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.736659 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.736753 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.736968 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.737059 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.737363 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.737659 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.737747 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.737976 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.738064 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.738295 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.738381 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.738615 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.738702 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.738925 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.739012 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.739248 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.739333 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.739562 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.739646 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.739871 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.739956 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.740190 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.740283 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.740498 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.740606 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.740829 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.740936 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.741191 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.741277 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.741501 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.741597 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.741812 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.741906 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.742124 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.742208 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.742428 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.742522 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.742731 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.742817 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.743036 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.743123 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.743343 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.743436 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.743651 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.743736 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.743955 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.744048 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.744258 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.744344 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.744563 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.744649 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.744912 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.745117 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.745245 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.745332 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.745547 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.745633 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.745851 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.745946 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.746157 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.746244 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.746455 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.746540 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.746757 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.746851 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.747060 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.747154 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.747366 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.747453 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.747667 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.747761 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.747969 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.748055 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.748275 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.748360 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.748573 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.748666 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.748874 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.749083 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.749198 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.749285 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.749498 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.749592 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.749796 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.749882 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.750129 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.750215 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.750462 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.750549 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.750773 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.750860 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.751084 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.751178 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.751391 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.751479 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.751709 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.751795 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.752013 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.752099 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.752326 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.752412 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.752647 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.752735 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.752976 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.753066 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.753290 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.753379 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.753603 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.753689 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.753918 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.754013 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.754226 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.754311 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.754537 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.754621 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.754845 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.755006 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.755153 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.755240 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.755462 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.755559 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.755785 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.755879 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.756101 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.756187 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.756404 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.756488 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.756728 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.756816 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.757065 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.757165 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.757396 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.757489 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.757707 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.757793 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.758014 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.758099 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.758325 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.758417 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.758640 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.758727 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.758947 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.759032 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.759256 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.759350 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.759565 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.759651 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.759873 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.759959 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.760193 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.760306 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.761046 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.761153 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.761363 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.761599 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.761694 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.761938 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.762034 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.762259 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.762345 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.762594 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.762697 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.762912 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.762997 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.763240 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.763332 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.763567 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.763667 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.763910 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.763997 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.764222 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.764309 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.764552 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.764646 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.764871 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.764985 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.765209 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.765296 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.765459 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105604) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 01 04:09:22.765555 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.765809 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:09:22.766053 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 01 04:09:22.918871 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO dbcounter [None req-5fbecef7-57df-4c86-9304-d4f3a6a049c3 None None] Registered counter for database nova_api Oct 01 04:09:22.919068 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO dbcounter [None req-40a18a23-485c-4712-98e1-e7bb311aab7f None None] Registered counter for database nova_api Oct 01 04:09:22.940897 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_db.sqlalchemy.engines [None req-5fbecef7-57df-4c86-9304-d4f3a6a049c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105605) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 04:09:22.942677 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG oslo_db.sqlalchemy.engines [None req-40a18a23-485c-4712-98e1-e7bb311aab7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 04:09:22.947658 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG dbcounter [-] [105605] Writer thread running {{(pid=105605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 04:09:22.949859 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG dbcounter [-] [105604] Writer thread running {{(pid=105604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 04:09:23.006886 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.context [None req-5fbecef7-57df-4c86-9304-d4f3a6a049c3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6637a42c-607b-4146-a74a-010d94c4cfd5(cell1) {{(pid=105605) load_cells /opt/stack/nova/nova/context.py:464}} Oct 01 04:09:23.007062 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.context [None req-40a18a23-485c-4712-98e1-e7bb311aab7f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6637a42c-607b-4146-a74a-010d94c4cfd5(cell1) {{(pid=105604) load_cells /opt/stack/nova/nova/context.py:464}} Oct 01 04:09:23.011296 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-5fbecef7-57df-4c86-9304-d4f3a6a049c3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:09:23.011492 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-40a18a23-485c-4712-98e1-e7bb311aab7f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:09:23.011768 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-5fbecef7-57df-4c86-9304-d4f3a6a049c3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:09:23.012105 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-40a18a23-485c-4712-98e1-e7bb311aab7f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:09:23.013360 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-5fbecef7-57df-4c86-9304-d4f3a6a049c3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:09:23.013721 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-40a18a23-485c-4712-98e1-e7bb311aab7f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:09:23.014083 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-5fbecef7-57df-4c86-9304-d4f3a6a049c3 None None] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:09:23.014454 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-40a18a23-485c-4712-98e1-e7bb311aab7f None None] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:09:23.014559 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-5fbecef7-57df-4c86-9304-d4f3a6a049c3 None None] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:09:23.014901 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-40a18a23-485c-4712-98e1-e7bb311aab7f None None] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:09:23.016485 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-5fbecef7-57df-4c86-9304-d4f3a6a049c3 None None] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:09:23.016877 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG oslo_concurrency.lockutils [None req-40a18a23-485c-4712-98e1-e7bb311aab7f None None] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105604) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:09:23.018497 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO dbcounter [None req-5fbecef7-57df-4c86-9304-d4f3a6a049c3 None None] Registered counter for database nova_cell0 Oct 01 04:09:23.018956 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO dbcounter [None req-40a18a23-485c-4712-98e1-e7bb311aab7f None None] Registered counter for database nova_cell0 Oct 01 04:09:23.022658 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO dbcounter [None req-5fbecef7-57df-4c86-9304-d4f3a6a049c3 None None] Registered counter for database nova_cell1 Oct 01 04:09:23.023163 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO dbcounter [None req-40a18a23-485c-4712-98e1-e7bb311aab7f None None] Registered counter for database nova_cell1 Oct 01 04:09:23.030139 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_db.sqlalchemy.engines [None req-5fbecef7-57df-4c86-9304-d4f3a6a049c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105605) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 04:09:23.032296 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_db.sqlalchemy.engines [None req-5fbecef7-57df-4c86-9304-d4f3a6a049c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105605) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 04:09:23.033874 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG oslo_db.sqlalchemy.engines [None req-40a18a23-485c-4712-98e1-e7bb311aab7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 04:09:23.036588 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG dbcounter [-] [105605] Writer thread running {{(pid=105605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 04:09:23.037323 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG oslo_db.sqlalchemy.engines [None req-40a18a23-485c-4712-98e1-e7bb311aab7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 04:09:23.040193 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG dbcounter [-] [105604] Writer thread running {{(pid=105604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 04:09:23.176729 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG dbcounter [-] [105605] Writer thread running {{(pid=105605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 04:09:23.184215 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG dbcounter [-] [105604] Writer thread running {{(pid=105604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 04:09:23.187133 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO dbcounter [None req-5fbecef7-57df-4c86-9304-d4f3a6a049c3 None None] Registered counter for database nova_cell0 Oct 01 04:09:23.194030 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO dbcounter [None req-40a18a23-485c-4712-98e1-e7bb311aab7f None None] Registered counter for database nova_cell0 Oct 01 04:09:23.195841 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_db.sqlalchemy.engines [None req-5fbecef7-57df-4c86-9304-d4f3a6a049c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105605) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 04:09:23.200748 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG dbcounter [-] [105605] Writer thread running {{(pid=105605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 04:09:23.201154 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG oslo_db.sqlalchemy.engines [None req-40a18a23-485c-4712-98e1-e7bb311aab7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105604) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 04:09:23.205802 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG dbcounter [-] [105604] Writer thread running {{(pid=105604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 04:09:23.535388 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: WARNING keystonemiddleware.auth_token [None req-5fbecef7-57df-4c86-9304-d4f3a6a049c3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 01 04:09:23.542131 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: WARNING keystonemiddleware.auth_token [None req-40a18a23-485c-4712-98e1-e7bb311aab7f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 01 04:09:23.542649 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: WARNING keystonemiddleware.auth_token [None req-5fbecef7-57df-4c86-9304-d4f3a6a049c3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 01 04:09:23.549454 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: WARNING keystonemiddleware.auth_token [None req-40a18a23-485c-4712-98e1-e7bb311aab7f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 01 04:09:23.881719 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: WARNING keystonemiddleware.auth_token [None req-5fbecef7-57df-4c86-9304-d4f3a6a049c3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 01 04:09:23.888399 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: WARNING keystonemiddleware.auth_token [None req-5fbecef7-57df-4c86-9304-d4f3a6a049c3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 01 04:09:23.894337 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: WARNING keystonemiddleware.auth_token [None req-40a18a23-485c-4712-98e1-e7bb311aab7f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 01 04:09:23.894486 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c7ea65c9c0 pid: 105605 (default app) Oct 01 04:09:23.897358 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-5fbecef7-57df-4c86-9304-d4f3a6a049c3 None None] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:09:23.898542 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-5fbecef7-57df-4c86-9304-d4f3a6a049c3 None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001771 Oct 01 04:09:23.899143 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Sat Oct 1 04:09:23 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:09:23.900314 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: WARNING keystonemiddleware.auth_token [None req-40a18a23-485c-4712-98e1-e7bb311aab7f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 01 04:09:23.906263 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55c7ea65c9c0 pid: 105604 (default app) Oct 01 04:10:46.048755 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-5fbecef7-57df-4c86-9304-d4f3a6a049c3 None None] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:10:46.049812 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-5fbecef7-57df-4c86-9304-d4f3a6a049c3 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Oct 01 04:10:46.050220 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 1 04:10:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:10:46.062975 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG dbcounter [-] [105604] Writing DB stats nova_api:SELECT=3 {{(pid=105604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:46.064141 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG dbcounter [-] [105604] Writing DB stats nova_cell0:SELECT=3 {{(pid=105604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:46.064913 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG dbcounter [-] [105604] Writing DB stats nova_cell1:SELECT=3 {{(pid=105604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:46.066913 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG dbcounter [-] [105604] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:46.954655 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-b76d446a-cecf-4ba4-831e-49b5929930b8 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:10:46.987605 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-b76d446a-cecf-4ba4-831e-49b5929930b8 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.929833 Oct 01 04:10:46.988336 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Oct 1 04:10:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:10:49.642066 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-5fbecef7-57df-4c86-9304-d4f3a6a049c3 None None] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:10:49.643044 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-5fbecef7-57df-4c86-9304-d4f3a6a049c3 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Oct 01 04:10:49.643605 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 1 04:10:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:10:50.107022 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-dd38d0ac-09c7-4eb4-9ca0-dfad739f5016 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "ram": 256, "name": "cirros256", "swap": 0, "vcpus": 1}} {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:10:50.157000 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-dd38d0ac-09c7-4eb4-9ca0-dfad739f5016 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.507200 Oct 01 04:10:50.157563 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 1 04:10:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 04:10:50.172063 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG dbcounter [-] [105605] Writing DB stats nova_api:SELECT=3 {{(pid=105605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:50.173807 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG dbcounter [-] [105605] Writing DB stats nova_cell1:SELECT=3 {{(pid=105605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:50.175759 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG dbcounter [-] [105605] Writing DB stats nova_cell0:SELECT=3 {{(pid=105605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:50.177680 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG dbcounter [-] [105605] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:10:50.384162 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-52b2d17c-de80-406a-935a-b62a838f7689 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:10:50.457493 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-52b2d17c-de80-406a-935a-b62a838f7689 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290724 Oct 01 04:10:50.458091 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Oct 1 04:10:50 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:10:53.178892 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-dd38d0ac-09c7-4eb4-9ca0-dfad739f5016 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:10:53.180102 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-dd38d0ac-09c7-4eb4-9ca0-dfad739f5016 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002297 Oct 01 04:10:53.180644 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 1 04:10:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:10:53.901569 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-c7cede29-cf90-4cfb-a76b-d110d07573ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "vcpus": 1, "swap": 0, "name": "ds512M", "ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5}} {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:10:53.944476 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-c7cede29-cf90-4cfb-a76b-d110d07573ae admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.757193 Oct 01 04:10:53.945067 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 1 04:10:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 04:10:53.956987 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-c8bb1aaf-9315-4c8f-93d3-e1c92db19ab9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:10:53.997074 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-c8bb1aaf-9315-4c8f-93d3-e1c92db19ab9 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043683 Oct 01 04:10:53.997860 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Oct 1 04:10:53 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:10:56.638874 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-c7cede29-cf90-4cfb-a76b-d110d07573ae admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:10:56.643495 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-c7cede29-cf90-4cfb-a76b-d110d07573ae admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004571 Oct 01 04:10:56.643923 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 1 04:10:56 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:10:57.059921 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-f7212e51-b2d8-4450-a7e9-705398345e22 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds1G", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d2", "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:10:57.081521 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-f7212e51-b2d8-4450-a7e9-705398345e22 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.430458 Oct 01 04:10:57.082188 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 1 04:10:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 04:10:57.094494 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-e0e1aa03-5b17-4a52-a10f-b792791f12f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:10:57.122254 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-e0e1aa03-5b17-4a52-a10f-b792791f12f3 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031506 Oct 01 04:10:57.122838 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Oct 1 04:10:57 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:10:59.722065 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-f7212e51-b2d8-4450-a7e9-705398345e22 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:10:59.723811 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-f7212e51-b2d8-4450-a7e9-705398345e22 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002260 Oct 01 04:10:59.725699 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 1 04:10:59 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:11:00.184057 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-9559e9ad-acac-40de-a883-38ebb979fd83 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d3", "name": "ds2G", "vcpus": 2, "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true}} {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:11:00.204612 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-9559e9ad-acac-40de-a883-38ebb979fd83 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.472229 Oct 01 04:11:00.205260 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 1 04:10:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 04:11:00.218062 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-b6dd4466-80d7-4fa5-8021-b98354981d4d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:11:00.246042 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-b6dd4466-80d7-4fa5-8021-b98354981d4d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031571 Oct 01 04:11:00.247405 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Oct 1 04:11:00 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:11:02.935590 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-9559e9ad-acac-40de-a883-38ebb979fd83 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:02.936589 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-9559e9ad-acac-40de-a883-38ebb979fd83 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 01 04:11:02.937011 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 1 04:11:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:11:03.397434 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-c7950dde-8515-4612-a0b7-6ce86a7b2dea admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 4096, "name": "ds4G", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "id": "d4"}} {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:11:03.419810 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-c7950dde-8515-4612-a0b7-6ce86a7b2dea admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.476731 Oct 01 04:11:03.420692 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 1 04:11:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 01 04:11:03.432811 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-ba0d9220-9cc9-44db-ba51-6babc63fdf51 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:11:03.458172 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-ba0d9220-9cc9-44db-ba51-6babc63fdf51 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028977 Oct 01 04:11:03.469748 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1336 bytes} [Sat Oct 1 04:11:03 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:11:06.116515 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-c7950dde-8515-4612-a0b7-6ce86a7b2dea admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:06.117593 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-c7950dde-8515-4612-a0b7-6ce86a7b2dea admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Oct 01 04:11:06.118065 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 1 04:11:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:11:06.519578 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-6276e4b8-5723-49a0-893a-8baa7217cbe6 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:06.544877 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-6276e4b8-5723-49a0-893a-8baa7217cbe6 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.419460 Oct 01 04:11:06.545453 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Oct 1 04:11:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:11:09.818001 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-c7950dde-8515-4612-a0b7-6ce86a7b2dea admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:09.819032 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-c7950dde-8515-4612-a0b7-6ce86a7b2dea admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001615 Oct 01 04:11:09.819442 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 1 04:11:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:11:10.222784 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-2e00075d-cfe9-4bc0-9cbe-1d033f57961b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "id": "1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.tiny", "ram": 512}} {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:11:10.242680 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-2e00075d-cfe9-4bc0-9cbe-1d033f57961b admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.417023 Oct 01 04:11:10.243309 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 1 04:11:09 2022] POST /compute/v2.1/flavors => generated 402 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 01 04:11:10.255804 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-e7e65cb4-65b7-408e-9639-60fb5b766013 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:11:10.282523 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-e7e65cb4-65b7-408e-9639-60fb5b766013 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031022 Oct 01 04:11:10.283084 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Oct 1 04:11:10 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:11:12.917782 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-2e00075d-cfe9-4bc0-9cbe-1d033f57961b admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:12.918795 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-2e00075d-cfe9-4bc0-9cbe-1d033f57961b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Oct 01 04:11:12.919212 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 1 04:11:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:11:13.289594 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-6e3e524e-3605-4665-8b2b-229afa3fadf4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 2048, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "disk": 20, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:11:13.307549 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-6e3e524e-3605-4665-8b2b-229afa3fadf4 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.382198 Oct 01 04:11:13.308092 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 1 04:11:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 01 04:11:13.321748 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-e04f29cd-846a-40fa-8f5b-d54969d13a01 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:11:13.346686 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-e04f29cd-846a-40fa-8f5b-d54969d13a01 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030128 Oct 01 04:11:13.347269 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Oct 1 04:11:13 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:11:16.009802 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-6e3e524e-3605-4665-8b2b-229afa3fadf4 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:16.011446 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-6e3e524e-3605-4665-8b2b-229afa3fadf4 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002119 Oct 01 04:11:16.011850 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 1 04:11:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:11:16.479176 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-61f39103-6a11-435a-867d-fe74367017be admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "os-flavor-access:is_public": true, "disk": 40, "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "m1.medium"}} {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:11:16.506953 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-61f39103-6a11-435a-867d-fe74367017be admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.488751 Oct 01 04:11:16.508198 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 1 04:11:16 2022] POST /compute/v2.1/flavors => generated 406 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 01 04:11:16.526424 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-fe0cf5f0-de1d-418e-8efc-8a1b6badf734 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:11:16.532074 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG dbcounter [-] [105604] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:16.559185 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-fe0cf5f0-de1d-418e-8efc-8a1b6badf734 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042820 Oct 01 04:11:16.560593 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Oct 1 04:11:16 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:11:19.429612 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-61f39103-6a11-435a-867d-fe74367017be admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:19.431263 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-61f39103-6a11-435a-867d-fe74367017be admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004305 Oct 01 04:11:19.436543 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 1 04:11:19 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:11:20.007773 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-2a4a3eeb-2b02-4a71-b9ce-5fa3de6246b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "id": "4", "name": "m1.large", "disk": 80, "swap": 0}} {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:11:20.031625 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-2a4a3eeb-2b02-4a71-b9ce-5fa3de6246b8 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.593680 Oct 01 04:11:20.032498 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 1 04:11:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 04:11:20.044803 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-c6426813-213c-43d7-9bef-60b82e265c46 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:11:20.069235 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-c6426813-213c-43d7-9bef-60b82e265c46 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028241 Oct 01 04:11:20.069815 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Oct 1 04:11:20 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:11:22.717816 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-2a4a3eeb-2b02-4a71-b9ce-5fa3de6246b8 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:22.718947 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-2a4a3eeb-2b02-4a71-b9ce-5fa3de6246b8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Oct 01 04:11:22.719435 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 1 04:11:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:11:23.184399 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-24a2c06e-8a2b-4f17-af9f-038c7374c1e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "os-flavor-access:is_public": true, "swap": 0, "disk": 160, "ram": 16384, "vcpus": 8, "id": "5", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:11:23.192162 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG dbcounter [-] [105605] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:23.212630 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-24a2c06e-8a2b-4f17-af9f-038c7374c1e0 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.487214 Oct 01 04:11:23.213363 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1283 bytes} [Sat Oct 1 04:11:22 2022] POST /compute/v2.1/flavors => generated 408 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 04:11:23.225654 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-583e3e10-8fcb-4aa0-8018-2630ba860ef6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:11:23.252780 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-583e3e10-8fcb-4aa0-8018-2630ba860ef6 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030999 Oct 01 04:11:23.253579 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1333 bytes} [Sat Oct 1 04:11:23 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:11:40.586711 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-24a2c06e-8a2b-4f17-af9f-038c7374c1e0 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:40.587716 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-24a2c06e-8a2b-4f17-af9f-038c7374c1e0 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 01 04:11:40.588116 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 1 04:11:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:11:40.599136 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG dbcounter [-] [105604] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:11:40.974782 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-1b6f50c8-472e-463e-9c86-642b487db04e admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:40.993859 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-1b6f50c8-472e-463e-9c86-642b487db04e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399614 Oct 01 04:11:40.994488 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Oct 1 04:11:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:11:42.293957 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-24a2c06e-8a2b-4f17-af9f-038c7374c1e0 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:42.294958 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-24a2c06e-8a2b-4f17-af9f-038c7374c1e0 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Oct 01 04:11:42.295381 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 1 04:11:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:11:42.824025 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-ad982788-4568-4b24-9b3e-66b20bd139c3 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:42.829337 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.wsgi [None req-ad982788-4568-4b24-9b3e-66b20bd139c3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 01 04:11:42.832550 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-ad982788-4568-4b24-9b3e-66b20bd139c3 admin admin] Request method failure captured: Oct 01 04:11:42.832550 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 01 04:11:42.832550 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: Accept: application/json Oct 01 04:11:42.832550 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: Accept-Encoding: gzip, deflate Oct 01 04:11:42.832550 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: Connection: keep-alive Oct 01 04:11:42.832550 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: Content-Length: 0 Oct 01 04:11:42.832550 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: Host: 10.222.0.26 Oct 01 04:11:42.832550 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: Openstack-Api-Version: compute 2.92 Oct 01 04:11:42.832550 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: Openstack-System-Scope: None Oct 01 04:11:42.832550 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: User-Agent: python-novaclient Oct 01 04:11:42.832550 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Auth-Token: gAAAAABjN73-LxDyZLP_BzfyJ7vnvwJ1BQ3KUisY99Yzif61h8Y-qpL112EzEXarpj9NBBFDaydPLb4ZASn11cVDiKAd0R7197ahz5ZXUe9WtSXSbx3S7oe8WKvDUuazEdhLgDXm3S4p4aZ_VngtjbjKS6x-5jznkOeCHZpyAdlTW5m0iXfM6Eo Oct 01 04:11:42.832550 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Domain-Id: None Oct 01 04:11:42.832550 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Domain-Name: None Oct 01 04:11:42.832550 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Identity-Status: Confirmed Oct 01 04:11:42.832550 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Is-Admin-Project: True Oct 01 04:11:42.832550 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Openstack-Nova-Api-Version: 2.92 Oct 01 04:11:42.832550 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Project-Domain-Id: default Oct 01 04:11:42.832550 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Project-Domain-Name: Default Oct 01 04:11:42.832550 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Project-Id: 49c20dd6d2894e7799f891fe5467c7e0 Oct 01 04:11:42.832550 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Project-Name: admin Oct 01 04:11:42.832550 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Role: reader,member,admin Oct 01 04:11:42.832550 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Roles: reader,member,admin Oct 01 04:11:42.835068 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_49c20dd6d2894e7799f891fe5467c7e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/49c20dd6d2894e7799f891fe5467c7e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/49c20dd6d2894e7799f891fe5467c7e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/49c20dd6d2894e7799f891fe5467c7e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:11:42.835068 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Tenant: admin Oct 01 04:11:42.835068 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Tenant-Id: 49c20dd6d2894e7799f891fe5467c7e0 Oct 01 04:11:42.835068 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Tenant-Name: admin Oct 01 04:11:42.835068 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-User: admin Oct 01 04:11:42.835068 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-User-Domain-Id: default Oct 01 04:11:42.835068 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-User-Domain-Name: Default Oct 01 04:11:42.835068 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-User-Id: 280e8a1dffee4eacad394696d3ff53d3 Oct 01 04:11:42.835068 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-User-Name: admin Oct 01 04:11:42.835068 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: method: > Oct 01 04:11:42.835068 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: exception: Flavor 42 could not be found. Oct 01 04:11:42.835068 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: action_args: {'id': '42'} Oct 01 04:11:42.835068 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:11:42.835068 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:11:42.836887 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 01 04:11:42.836887 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 01 04:11:42.836887 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 01 04:11:42.836887 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 01 04:11:42.836887 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 04:11:42.836887 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 04:11:42.836887 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 01 04:11:42.836887 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 01 04:11:42.836887 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 01 04:11:42.836887 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:11:42.836887 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 01 04:11:42.836887 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 01 04:11:42.836887 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 01 04:11:42.836887 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Oct 01 04:11:42.836887 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:11:42.836887 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Oct 01 04:11:42.836887 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:11:42.836887 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:11:42.836887 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:11:42.839418 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:11:42.839418 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:11:42.839418 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:11:42.839418 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:11:42.839418 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 01 04:11:42.839418 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:11:42.839418 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 01 04:11:42.839418 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Oct 01 04:11:42.839418 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:11:42.839418 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Oct 01 04:11:42.839418 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:11:42.839418 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:11:42.839418 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:11:42.839418 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:11:42.839418 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:11:42.839418 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 01 04:11:42.839418 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Oct 01 04:11:42.839418 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-ad982788-4568-4b24-9b3e-66b20bd139c3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:11:42.841705 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-ad982788-4568-4b24-9b3e-66b20bd139c3 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.396335 Oct 01 04:11:42.841705 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Oct 1 04:11:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 01 04:11:42.846973 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-103708f6-8c6b-49f8-b441-a098025f79c9 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:42.870995 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-103708f6-8c6b-49f8-b441-a098025f79c9 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027864 Oct 01 04:11:42.871536 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Oct 1 04:11:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:11:42.882531 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-afe35038-d386-4d80-82dc-13eccdbc4f13 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:42.904643 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-afe35038-d386-4d80-82dc-13eccdbc4f13 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026903 Oct 01 04:11:42.905217 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Oct 1 04:11:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:11:42.914999 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-07752089-1062-4313-ba71-395b23721a13 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:42.920389 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.wsgi [None req-07752089-1062-4313-ba71-395b23721a13 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 01 04:11:42.923676 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-07752089-1062-4313-ba71-395b23721a13 admin admin] Request method failure captured: Oct 01 04:11:42.923676 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 01 04:11:42.923676 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: Accept: application/json Oct 01 04:11:42.923676 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: Accept-Encoding: gzip, deflate Oct 01 04:11:42.923676 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: Connection: keep-alive Oct 01 04:11:42.923676 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: Content-Length: 0 Oct 01 04:11:42.923676 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: Host: 10.222.0.26 Oct 01 04:11:42.923676 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: Openstack-Api-Version: compute 2.92 Oct 01 04:11:42.923676 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: Openstack-System-Scope: None Oct 01 04:11:42.923676 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: User-Agent: python-novaclient Oct 01 04:11:42.923676 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Auth-Token: gAAAAABjN73-LxDyZLP_BzfyJ7vnvwJ1BQ3KUisY99Yzif61h8Y-qpL112EzEXarpj9NBBFDaydPLb4ZASn11cVDiKAd0R7197ahz5ZXUe9WtSXSbx3S7oe8WKvDUuazEdhLgDXm3S4p4aZ_VngtjbjKS6x-5jznkOeCHZpyAdlTW5m0iXfM6Eo Oct 01 04:11:42.923676 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Domain-Id: None Oct 01 04:11:42.923676 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Domain-Name: None Oct 01 04:11:42.923676 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Identity-Status: Confirmed Oct 01 04:11:42.923676 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Is-Admin-Project: True Oct 01 04:11:42.923676 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Openstack-Nova-Api-Version: 2.92 Oct 01 04:11:42.923676 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Project-Domain-Id: default Oct 01 04:11:42.923676 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Project-Domain-Name: Default Oct 01 04:11:42.923676 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Project-Id: 49c20dd6d2894e7799f891fe5467c7e0 Oct 01 04:11:42.923676 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Project-Name: admin Oct 01 04:11:42.923676 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Role: reader,member,admin Oct 01 04:11:42.923676 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Roles: reader,member,admin Oct 01 04:11:42.925321 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_49c20dd6d2894e7799f891fe5467c7e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/49c20dd6d2894e7799f891fe5467c7e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/49c20dd6d2894e7799f891fe5467c7e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/49c20dd6d2894e7799f891fe5467c7e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:11:42.925321 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Tenant: admin Oct 01 04:11:42.925321 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Tenant-Id: 49c20dd6d2894e7799f891fe5467c7e0 Oct 01 04:11:42.925321 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Tenant-Name: admin Oct 01 04:11:42.925321 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-User: admin Oct 01 04:11:42.925321 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-User-Domain-Id: default Oct 01 04:11:42.925321 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-User-Domain-Name: Default Oct 01 04:11:42.925321 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-User-Id: 280e8a1dffee4eacad394696d3ff53d3 Oct 01 04:11:42.925321 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-User-Name: admin Oct 01 04:11:42.925321 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: method: > Oct 01 04:11:42.925321 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: exception: Flavor 42 could not be found. Oct 01 04:11:42.925321 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: action_args: {'id': '42'} Oct 01 04:11:42.925321 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:11:42.925321 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:11:42.926292 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 01 04:11:42.926292 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 01 04:11:42.926292 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 01 04:11:42.926292 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 01 04:11:42.926292 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 04:11:42.926292 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 04:11:42.926292 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 01 04:11:42.926292 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 01 04:11:42.926292 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 01 04:11:42.926292 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:11:42.926292 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 01 04:11:42.926292 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 01 04:11:42.926292 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 01 04:11:42.926292 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Oct 01 04:11:42.926292 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:11:42.926292 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Oct 01 04:11:42.926292 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:11:42.926292 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:11:42.926292 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:11:42.928299 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:11:42.928299 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:11:42.928299 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:11:42.928299 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:11:42.928299 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 01 04:11:42.928299 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:11:42.928299 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 01 04:11:42.928299 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Oct 01 04:11:42.928299 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:11:42.928299 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Oct 01 04:11:42.928299 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:11:42.928299 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:11:42.928299 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:11:42.928299 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:11:42.928299 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:11:42.928299 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 01 04:11:42.928299 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Oct 01 04:11:42.928299 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-07752089-1062-4313-ba71-395b23721a13 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:11:42.929552 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-07752089-1062-4313-ba71-395b23721a13 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014112 Oct 01 04:11:42.929552 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Oct 1 04:11:42 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 01 04:11:44.279339 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-afe35038-d386-4d80-82dc-13eccdbc4f13 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:44.280403 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-afe35038-d386-4d80-82dc-13eccdbc4f13 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Oct 01 04:11:44.280802 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 1 04:11:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:11:44.798773 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-e624a0f6-2c4c-4568-9a33-8df49c4da156 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:44.804114 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.wsgi [None req-e624a0f6-2c4c-4568-9a33-8df49c4da156 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 01 04:11:44.805708 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-e624a0f6-2c4c-4568-9a33-8df49c4da156 admin admin] Request method failure captured: Oct 01 04:11:44.805708 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 01 04:11:44.805708 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: Accept: application/json Oct 01 04:11:44.805708 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: Accept-Encoding: gzip, deflate Oct 01 04:11:44.805708 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: Connection: keep-alive Oct 01 04:11:44.805708 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: Content-Length: 0 Oct 01 04:11:44.805708 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: Host: 10.222.0.26 Oct 01 04:11:44.805708 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: Openstack-Api-Version: compute 2.92 Oct 01 04:11:44.805708 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: Openstack-System-Scope: None Oct 01 04:11:44.805708 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: User-Agent: python-novaclient Oct 01 04:11:44.805708 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Auth-Token: gAAAAABjN74AJuwAR7pvKUDaflbDT7hKHJfqPb-06paNNGI-zuPg_s4tNYZeZWtY9qRIiXzThv2SdutLiMVUL7srMVH2UZQX6tFmWHlOz6t0ZfUX-P-rCqEdMnX3jYcmxYf80cLI-q6AHTR8k9whD9TjKYTFGQ3zs-Ikx0KPlUqU_Tt6T53qVnE Oct 01 04:11:44.805708 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Domain-Id: None Oct 01 04:11:44.805708 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Domain-Name: None Oct 01 04:11:44.805708 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Identity-Status: Confirmed Oct 01 04:11:44.805708 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Is-Admin-Project: True Oct 01 04:11:44.805708 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Openstack-Nova-Api-Version: 2.92 Oct 01 04:11:44.805708 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Project-Domain-Id: default Oct 01 04:11:44.805708 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Project-Domain-Name: Default Oct 01 04:11:44.805708 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Project-Id: 49c20dd6d2894e7799f891fe5467c7e0 Oct 01 04:11:44.805708 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Project-Name: admin Oct 01 04:11:44.805708 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Role: reader,member,admin Oct 01 04:11:44.805708 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Roles: reader,member,admin Oct 01 04:11:44.807208 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_49c20dd6d2894e7799f891fe5467c7e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/49c20dd6d2894e7799f891fe5467c7e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/49c20dd6d2894e7799f891fe5467c7e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/49c20dd6d2894e7799f891fe5467c7e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:11:44.807208 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Tenant: admin Oct 01 04:11:44.807208 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Tenant-Id: 49c20dd6d2894e7799f891fe5467c7e0 Oct 01 04:11:44.807208 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Tenant-Name: admin Oct 01 04:11:44.807208 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-User: admin Oct 01 04:11:44.807208 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-User-Domain-Id: default Oct 01 04:11:44.807208 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-User-Domain-Name: Default Oct 01 04:11:44.807208 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-User-Id: 280e8a1dffee4eacad394696d3ff53d3 Oct 01 04:11:44.807208 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-User-Name: admin Oct 01 04:11:44.807208 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: method: > Oct 01 04:11:44.807208 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: exception: Flavor 84 could not be found. Oct 01 04:11:44.807208 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: action_args: {'id': '84'} Oct 01 04:11:44.807208 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:11:44.807208 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:11:44.808079 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 01 04:11:44.808079 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 01 04:11:44.808079 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 01 04:11:44.808079 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 01 04:11:44.808079 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 04:11:44.808079 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 04:11:44.808079 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 01 04:11:44.808079 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 01 04:11:44.808079 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 01 04:11:44.808079 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:11:44.808079 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 01 04:11:44.808079 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 01 04:11:44.808079 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 01 04:11:44.808079 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Oct 01 04:11:44.808079 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:11:44.808079 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Oct 01 04:11:44.808079 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:11:44.808079 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:11:44.808079 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:11:44.809382 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:11:44.809382 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:11:44.809382 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:11:44.809382 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:11:44.809382 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 01 04:11:44.809382 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:11:44.809382 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 01 04:11:44.809382 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Oct 01 04:11:44.809382 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:11:44.809382 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Oct 01 04:11:44.809382 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:11:44.809382 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:11:44.809382 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:11:44.809382 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:11:44.809382 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:11:44.809382 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 01 04:11:44.809382 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Oct 01 04:11:44.809382 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-e624a0f6-2c4c-4568-9a33-8df49c4da156 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:11:44.810709 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-e624a0f6-2c4c-4568-9a33-8df49c4da156 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.388147 Oct 01 04:11:44.810709 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Oct 1 04:11:44 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 01 04:11:44.817743 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-ad96197f-4dc9-4973-9413-2c2ab3464575 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:44.835540 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-ad96197f-4dc9-4973-9413-2c2ab3464575 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021993 Oct 01 04:11:44.836019 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Oct 1 04:11:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:11:44.845667 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-f65e1f10-d90f-4f9e-8703-ccc2771dcf93 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:44.861773 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-f65e1f10-d90f-4f9e-8703-ccc2771dcf93 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019637 Oct 01 04:11:44.862425 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Oct 1 04:11:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:11:44.871813 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-d6d3f431-87ac-419f-bb43-d74aaf6cf02a admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:44.876777 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.wsgi [None req-d6d3f431-87ac-419f-bb43-d74aaf6cf02a admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 01 04:11:44.878307 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-d6d3f431-87ac-419f-bb43-d74aaf6cf02a admin admin] Request method failure captured: Oct 01 04:11:44.878307 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 01 04:11:44.878307 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: Accept: application/json Oct 01 04:11:44.878307 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: Accept-Encoding: gzip, deflate Oct 01 04:11:44.878307 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: Connection: keep-alive Oct 01 04:11:44.878307 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: Content-Length: 0 Oct 01 04:11:44.878307 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: Host: 10.222.0.26 Oct 01 04:11:44.878307 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: Openstack-Api-Version: compute 2.92 Oct 01 04:11:44.878307 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: Openstack-System-Scope: None Oct 01 04:11:44.878307 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: User-Agent: python-novaclient Oct 01 04:11:44.878307 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Auth-Token: gAAAAABjN74AJuwAR7pvKUDaflbDT7hKHJfqPb-06paNNGI-zuPg_s4tNYZeZWtY9qRIiXzThv2SdutLiMVUL7srMVH2UZQX6tFmWHlOz6t0ZfUX-P-rCqEdMnX3jYcmxYf80cLI-q6AHTR8k9whD9TjKYTFGQ3zs-Ikx0KPlUqU_Tt6T53qVnE Oct 01 04:11:44.878307 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Domain-Id: None Oct 01 04:11:44.878307 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Domain-Name: None Oct 01 04:11:44.878307 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Identity-Status: Confirmed Oct 01 04:11:44.878307 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Is-Admin-Project: True Oct 01 04:11:44.878307 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Openstack-Nova-Api-Version: 2.92 Oct 01 04:11:44.878307 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Project-Domain-Id: default Oct 01 04:11:44.878307 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Project-Domain-Name: Default Oct 01 04:11:44.878307 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Project-Id: 49c20dd6d2894e7799f891fe5467c7e0 Oct 01 04:11:44.878307 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Project-Name: admin Oct 01 04:11:44.878307 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Role: reader,member,admin Oct 01 04:11:44.878307 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Roles: reader,member,admin Oct 01 04:11:44.879865 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_49c20dd6d2894e7799f891fe5467c7e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/49c20dd6d2894e7799f891fe5467c7e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/49c20dd6d2894e7799f891fe5467c7e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/49c20dd6d2894e7799f891fe5467c7e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:11:44.879865 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Tenant: admin Oct 01 04:11:44.879865 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Tenant-Id: 49c20dd6d2894e7799f891fe5467c7e0 Oct 01 04:11:44.879865 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Tenant-Name: admin Oct 01 04:11:44.879865 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-User: admin Oct 01 04:11:44.879865 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-User-Domain-Id: default Oct 01 04:11:44.879865 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-User-Domain-Name: Default Oct 01 04:11:44.879865 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-User-Id: 280e8a1dffee4eacad394696d3ff53d3 Oct 01 04:11:44.879865 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-User-Name: admin Oct 01 04:11:44.879865 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: method: > Oct 01 04:11:44.879865 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: exception: Flavor 84 could not be found. Oct 01 04:11:44.879865 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: action_args: {'id': '84'} Oct 01 04:11:44.879865 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:11:44.879865 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:11:44.880682 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 01 04:11:44.880682 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 01 04:11:44.880682 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 01 04:11:44.880682 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 01 04:11:44.880682 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 04:11:44.880682 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 04:11:44.880682 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 01 04:11:44.880682 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 01 04:11:44.880682 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 01 04:11:44.880682 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:11:44.880682 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 01 04:11:44.880682 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 01 04:11:44.880682 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 01 04:11:44.880682 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Oct 01 04:11:44.880682 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:11:44.880682 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Oct 01 04:11:44.880682 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:11:44.880682 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:11:44.880682 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:11:44.881963 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:11:44.881963 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:11:44.881963 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:11:44.881963 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:11:44.881963 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 01 04:11:44.881963 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:11:44.881963 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 01 04:11:44.881963 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Oct 01 04:11:44.881963 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:11:44.881963 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Oct 01 04:11:44.881963 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:11:44.881963 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:11:44.881963 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:11:44.881963 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:11:44.881963 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:11:44.881963 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 01 04:11:44.881963 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Oct 01 04:11:44.881963 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-d6d3f431-87ac-419f-bb43-d74aaf6cf02a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:11:44.883163 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-d6d3f431-87ac-419f-bb43-d74aaf6cf02a admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011392 Oct 01 04:11:44.883163 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Sat Oct 1 04:11:44 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 01 04:11:46.190976 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-f65e1f10-d90f-4f9e-8703-ccc2771dcf93 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:46.191986 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-f65e1f10-d90f-4f9e-8703-ccc2771dcf93 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Oct 01 04:11:46.192893 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 1 04:11:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:11:46.713005 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-281e2a0d-c9ad-442b-a17b-b8b74b382231 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:46.718847 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.wsgi [None req-281e2a0d-c9ad-442b-a17b-b8b74b382231 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 01 04:11:46.720362 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-281e2a0d-c9ad-442b-a17b-b8b74b382231 admin admin] Request method failure captured: Oct 01 04:11:46.720362 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 01 04:11:46.720362 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: Accept: application/json Oct 01 04:11:46.720362 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: Accept-Encoding: gzip, deflate Oct 01 04:11:46.720362 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: Connection: keep-alive Oct 01 04:11:46.720362 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: Content-Length: 0 Oct 01 04:11:46.720362 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: Host: 10.222.0.26 Oct 01 04:11:46.720362 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: Openstack-Api-Version: compute 2.92 Oct 01 04:11:46.720362 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: Openstack-System-Scope: None Oct 01 04:11:46.720362 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: User-Agent: python-novaclient Oct 01 04:11:46.720362 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Auth-Token: gAAAAABjN74CWkRWZUNh23aWo8K0Ni0pfGY0rrg7bYZqI9RlvgbbKgEKzM4OC3_2fYfLKJ45vQt1cKyHLPeANWOUCvkigno7q0iyCT-h9EHCpIZW7K-cTrYkAyDxVn_PCrb5crzrvsdBpC0sGmYl2CI-wjtkzlaNgTIc4I60OjtKqlhdBY9v7is Oct 01 04:11:46.720362 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Domain-Id: None Oct 01 04:11:46.720362 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Domain-Name: None Oct 01 04:11:46.720362 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Identity-Status: Confirmed Oct 01 04:11:46.720362 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Is-Admin-Project: True Oct 01 04:11:46.720362 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Openstack-Nova-Api-Version: 2.92 Oct 01 04:11:46.720362 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Project-Domain-Id: default Oct 01 04:11:46.720362 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Project-Domain-Name: Default Oct 01 04:11:46.720362 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Project-Id: 49c20dd6d2894e7799f891fe5467c7e0 Oct 01 04:11:46.720362 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Project-Name: admin Oct 01 04:11:46.720362 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Role: reader,member,admin Oct 01 04:11:46.720362 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Roles: reader,member,admin Oct 01 04:11:46.721935 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_49c20dd6d2894e7799f891fe5467c7e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/49c20dd6d2894e7799f891fe5467c7e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/49c20dd6d2894e7799f891fe5467c7e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/49c20dd6d2894e7799f891fe5467c7e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:11:46.721935 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Tenant: admin Oct 01 04:11:46.721935 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Tenant-Id: 49c20dd6d2894e7799f891fe5467c7e0 Oct 01 04:11:46.721935 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-Tenant-Name: admin Oct 01 04:11:46.721935 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-User: admin Oct 01 04:11:46.721935 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-User-Domain-Id: default Oct 01 04:11:46.721935 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-User-Domain-Name: Default Oct 01 04:11:46.721935 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-User-Id: 280e8a1dffee4eacad394696d3ff53d3 Oct 01 04:11:46.721935 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: X-User-Name: admin Oct 01 04:11:46.721935 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: method: > Oct 01 04:11:46.721935 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: exception: Flavor 451 could not be found. Oct 01 04:11:46.721935 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: action_args: {'id': '451'} Oct 01 04:11:46.721935 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:11:46.721935 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:11:46.722982 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 01 04:11:46.722982 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 01 04:11:46.722982 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 01 04:11:46.722982 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 01 04:11:46.722982 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 04:11:46.722982 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 04:11:46.722982 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 01 04:11:46.722982 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 01 04:11:46.722982 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 01 04:11:46.722982 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:11:46.722982 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 01 04:11:46.722982 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 01 04:11:46.722982 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 01 04:11:46.722982 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Oct 01 04:11:46.722982 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:11:46.722982 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Oct 01 04:11:46.722982 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:11:46.722982 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:11:46.722982 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:11:46.725132 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:11:46.725132 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:11:46.725132 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:11:46.725132 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:11:46.725132 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 01 04:11:46.725132 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:11:46.725132 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 01 04:11:46.725132 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Oct 01 04:11:46.725132 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:11:46.725132 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Oct 01 04:11:46.725132 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:11:46.725132 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:11:46.725132 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:11:46.725132 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:11:46.725132 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:11:46.725132 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 01 04:11:46.725132 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: ERROR nova.api.openstack.wsgi Oct 01 04:11:46.725132 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-281e2a0d-c9ad-442b-a17b-b8b74b382231 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105604) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:11:46.726422 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-281e2a0d-c9ad-442b-a17b-b8b74b382231 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.390867 Oct 01 04:11:46.726422 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Oct 1 04:11:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 01 04:11:46.731884 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-7dcb4b08-6125-428e-9f4c-4a81c70c1c2e admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:46.747609 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-7dcb4b08-6125-428e-9f4c-4a81c70c1c2e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019262 Oct 01 04:11:46.748139 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Oct 1 04:11:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:11:46.757804 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-2fb29e98-6cc0-4b8f-bf99-f83bfa69981a admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:46.772874 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-2fb29e98-6cc0-4b8f-bf99-f83bfa69981a admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018828 Oct 01 04:11:46.773423 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Sat Oct 1 04:11:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:11:46.782553 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-a61188c1-605c-495f-80dd-43ea531eaed0 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:46.788411 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.wsgi [None req-a61188c1-605c-495f-80dd-43ea531eaed0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 01 04:11:46.789919 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-a61188c1-605c-495f-80dd-43ea531eaed0 admin admin] Request method failure captured: Oct 01 04:11:46.789919 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 01 04:11:46.789919 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: Accept: application/json Oct 01 04:11:46.789919 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: Accept-Encoding: gzip, deflate Oct 01 04:11:46.789919 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: Connection: keep-alive Oct 01 04:11:46.789919 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: Content-Length: 0 Oct 01 04:11:46.789919 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: Host: 10.222.0.26 Oct 01 04:11:46.789919 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: Openstack-Api-Version: compute 2.92 Oct 01 04:11:46.789919 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: Openstack-System-Scope: None Oct 01 04:11:46.789919 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: User-Agent: python-novaclient Oct 01 04:11:46.789919 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Auth-Token: gAAAAABjN74CWkRWZUNh23aWo8K0Ni0pfGY0rrg7bYZqI9RlvgbbKgEKzM4OC3_2fYfLKJ45vQt1cKyHLPeANWOUCvkigno7q0iyCT-h9EHCpIZW7K-cTrYkAyDxVn_PCrb5crzrvsdBpC0sGmYl2CI-wjtkzlaNgTIc4I60OjtKqlhdBY9v7is Oct 01 04:11:46.789919 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Domain-Id: None Oct 01 04:11:46.789919 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Domain-Name: None Oct 01 04:11:46.789919 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Identity-Status: Confirmed Oct 01 04:11:46.789919 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Is-Admin-Project: True Oct 01 04:11:46.789919 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Openstack-Nova-Api-Version: 2.92 Oct 01 04:11:46.789919 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Project-Domain-Id: default Oct 01 04:11:46.789919 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Project-Domain-Name: Default Oct 01 04:11:46.789919 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Project-Id: 49c20dd6d2894e7799f891fe5467c7e0 Oct 01 04:11:46.789919 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Project-Name: admin Oct 01 04:11:46.789919 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Role: reader,member,admin Oct 01 04:11:46.789919 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Roles: reader,member,admin Oct 01 04:11:46.791557 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_49c20dd6d2894e7799f891fe5467c7e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/49c20dd6d2894e7799f891fe5467c7e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/49c20dd6d2894e7799f891fe5467c7e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/49c20dd6d2894e7799f891fe5467c7e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:11:46.791557 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Tenant: admin Oct 01 04:11:46.791557 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Tenant-Id: 49c20dd6d2894e7799f891fe5467c7e0 Oct 01 04:11:46.791557 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-Tenant-Name: admin Oct 01 04:11:46.791557 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-User: admin Oct 01 04:11:46.791557 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-User-Domain-Id: default Oct 01 04:11:46.791557 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-User-Domain-Name: Default Oct 01 04:11:46.791557 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-User-Id: 280e8a1dffee4eacad394696d3ff53d3 Oct 01 04:11:46.791557 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: X-User-Name: admin Oct 01 04:11:46.791557 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: method: > Oct 01 04:11:46.791557 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: exception: Flavor 451 could not be found. Oct 01 04:11:46.791557 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: action_args: {'id': '451'} Oct 01 04:11:46.791557 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:11:46.791557 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:11:46.792674 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 01 04:11:46.792674 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 01 04:11:46.792674 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 01 04:11:46.792674 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 01 04:11:46.792674 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 04:11:46.792674 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 04:11:46.792674 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 01 04:11:46.792674 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 01 04:11:46.792674 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 01 04:11:46.792674 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:11:46.792674 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 01 04:11:46.792674 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 01 04:11:46.792674 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 01 04:11:46.792674 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Oct 01 04:11:46.792674 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:11:46.792674 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Oct 01 04:11:46.792674 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:11:46.792674 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:11:46.792674 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:11:46.794057 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:11:46.794057 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:11:46.794057 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:11:46.794057 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:11:46.794057 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 01 04:11:46.794057 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:11:46.794057 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 01 04:11:46.794057 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Oct 01 04:11:46.794057 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:11:46.794057 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Oct 01 04:11:46.794057 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:11:46.794057 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:11:46.794057 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:11:46.794057 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:11:46.794057 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:11:46.794057 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 01 04:11:46.794057 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: ERROR nova.api.openstack.wsgi Oct 01 04:11:46.794057 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-a61188c1-605c-495f-80dd-43ea531eaed0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105605) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:11:46.795388 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-a61188c1-605c-495f-80dd-43ea531eaed0 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012106 Oct 01 04:11:46.795388 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Oct 1 04:11:46 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 01 04:11:48.015919 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-2fb29e98-6cc0-4b8f-bf99-f83bfa69981a admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:48.016939 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-2fb29e98-6cc0-4b8f-bf99-f83bfa69981a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 01 04:11:48.017347 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 1 04:11:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:11:48.532969 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-6b0ffba8-4931-4ecc-b7ae-82368c34c9b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:11:48.553016 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-6b0ffba8-4931-4ecc-b7ae-82368c34c9b2 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.396975 Oct 01 04:11:48.553505 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Sat Oct 1 04:11:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 01 04:11:49.774982 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-2fb29e98-6cc0-4b8f-bf99-f83bfa69981a admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:49.776019 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-2fb29e98-6cc0-4b8f-bf99-f83bfa69981a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Oct 01 04:11:49.776410 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 1 04:11:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:11:50.293432 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-ab901324-7809-408d-85ff-51ef71fadcfa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:11:50.311351 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-ab901324-7809-408d-85ff-51ef71fadcfa admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.397370 Oct 01 04:11:50.311899 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Sat Oct 1 04:11:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 04:11:51.548437 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-2fb29e98-6cc0-4b8f-bf99-f83bfa69981a admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:51.549480 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-2fb29e98-6cc0-4b8f-bf99-f83bfa69981a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 01 04:11:51.549870 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 1 04:11:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:11:52.071615 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-65ec3c30-f89f-448b-a738-ceaa48d3ffff admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:11:52.091550 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-65ec3c30-f89f-448b-a738-ceaa48d3ffff admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.405069 Oct 01 04:11:52.092131 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Sat Oct 1 04:11:51 2022] POST /compute/v2.1/flavors => generated 407 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 04:11:53.304869 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-2fb29e98-6cc0-4b8f-bf99-f83bfa69981a admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:53.305899 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-2fb29e98-6cc0-4b8f-bf99-f83bfa69981a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 01 04:11:53.306300 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 1 04:11:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:11:53.823770 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-196f2f5a-3dee-4168-9973-39064cf60337 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:11:53.842621 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-196f2f5a-3dee-4168-9973-39064cf60337 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.400650 Oct 01 04:11:53.843165 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Sat Oct 1 04:11:53 2022] POST /compute/v2.1/flavors => generated 409 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 04:11:55.075351 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-2fb29e98-6cc0-4b8f-bf99-f83bfa69981a admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:55.076369 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-2fb29e98-6cc0-4b8f-bf99-f83bfa69981a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 01 04:11:55.076769 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 1 04:11:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:11:55.598304 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-e8e91fbe-a59d-47b4-8871-e5fa01b805a1 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:11:55.618440 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-e8e91fbe-a59d-47b4-8871-e5fa01b805a1 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.403062 Oct 01 04:11:55.618977 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Sat Oct 1 04:11:55 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:12:52.471382 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-2fb29e98-6cc0-4b8f-bf99-f83bfa69981a admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:12:52.472622 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-2fb29e98-6cc0-4b8f-bf99-f83bfa69981a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Oct 01 04:12:52.473063 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 931 bytes} [Sat Oct 1 04:12:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:12:52.483552 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG dbcounter [-] [105605] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:12:52.860441 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-b7b85613-9988-4e5c-88f4-a3f534f9cdee admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:12:52.881550 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-b7b85613-9988-4e5c-88f4-a3f534f9cdee admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.402565 Oct 01 04:12:52.882090 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1292 bytes} [Sat Oct 1 04:12:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:12:52.903687 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG dbcounter [-] [105604] Writing DB stats nova_api:SELECT=14 {{(pid=105604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:12:52.907648 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-bf95919c-5a68-440b-86b6-08e6011ebf59 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:12:52.915216 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-bf95919c-5a68-440b-86b6-08e6011ebf59 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013298 Oct 01 04:12:52.915734 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1283 bytes} [Sat Oct 1 04:12:52 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:12:52.927199 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-6a4b1129-d17f-46e1-8058-e901aeaf6ef3 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:12:52.934401 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-6a4b1129-d17f-46e1-8058-e901aeaf6ef3 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010756 Oct 01 04:12:52.934905 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1286 bytes} [Sat Oct 1 04:12:52 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:12:52.946483 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-0cf606b3-cb4b-458c-a2e9-4304dbb5ca47 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:12:52.953551 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-0cf606b3-cb4b-458c-a2e9-4304dbb5ca47 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010532 Oct 01 04:12:52.954064 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1286 bytes} [Sat Oct 1 04:12:52 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:12:52.965932 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-fd853509-c6b2-4624-a38e-79071c4a8ecc admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:12:52.973622 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-fd853509-c6b2-4624-a38e-79071c4a8ecc admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011138 Oct 01 04:12:52.974283 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1283 bytes} [Sat Oct 1 04:12:52 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:15:46.956296 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-0cf606b3-cb4b-458c-a2e9-4304dbb5ca47 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:15:46.957347 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-0cf606b3-cb4b-458c-a2e9-4304dbb5ca47 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Oct 01 04:15:46.957753 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 34/69] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 1 04:15:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:15:47.100151 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG dbcounter [-] [105605] Writing DB stats nova_api:SELECT=6 {{(pid=105605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:15:47.262941 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-cc0c7b20-5886-4ae1-9db3-7d788bfb6f9a admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:15:47.268233 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-cc0c7b20-5886-4ae1-9db3-7d788bfb6f9a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:15:47.268711 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-cc0c7b20-5886-4ae1-9db3-7d788bfb6f9a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:15:47.269180 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-cc0c7b20-5886-4ae1-9db3-7d788bfb6f9a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:15:47.269896 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-cc0c7b20-5886-4ae1-9db3-7d788bfb6f9a admin admin] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:15:47.270346 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-cc0c7b20-5886-4ae1-9db3-7d788bfb6f9a admin admin] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:15:47.270769 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-cc0c7b20-5886-4ae1-9db3-7d788bfb6f9a admin admin] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:15:47.303752 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-cc0c7b20-5886-4ae1-9db3-7d788bfb6f9a admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.204801 Oct 01 04:15:47.304313 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 36/70] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Oct 1 04:15:47 2022] GET /compute/v2.1/os-services => generated 791 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 04:15:48.504325 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-0cf606b3-cb4b-458c-a2e9-4304dbb5ca47 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:15:48.505546 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-0cf606b3-cb4b-458c-a2e9-4304dbb5ca47 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Oct 01 04:15:48.506249 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 1 04:15:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:15:48.720276 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-d2769628-a246-4754-8767-fb0d7e4f7a20 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:15:48.723719 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-d2769628-a246-4754-8767-fb0d7e4f7a20 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:15:48.724192 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-d2769628-a246-4754-8767-fb0d7e4f7a20 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:15:48.724749 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-d2769628-a246-4754-8767-fb0d7e4f7a20 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:15:48.725601 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-d2769628-a246-4754-8767-fb0d7e4f7a20 admin admin] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:15:48.726053 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-d2769628-a246-4754-8767-fb0d7e4f7a20 admin admin] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:15:48.726470 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-d2769628-a246-4754-8767-fb0d7e4f7a20 admin admin] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:15:48.747151 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-d2769628-a246-4754-8767-fb0d7e4f7a20 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.078040 Oct 01 04:15:48.747721 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 37/72] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Oct 1 04:15:48 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 04:16:00.244327 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-0cf606b3-cb4b-458c-a2e9-4304dbb5ca47 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:16:00.245402 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-0cf606b3-cb4b-458c-a2e9-4304dbb5ca47 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 01 04:16:00.245795 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 36/73] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 1 04:16:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:16:00.390845 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG dbcounter [-] [105605] Writing DB stats nova_cell0:SELECT=4 {{(pid=105605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:16:00.392083 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG dbcounter [-] [105605] Writing DB stats nova_cell1:SELECT=4 {{(pid=105605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:16:00.392682 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG dbcounter [-] [105605] Writing DB stats nova_api:SELECT=8 {{(pid=105605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:16:00.440771 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-e097cd90-26df-410e-8442-d5d7d7cf6477 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:16:00.444195 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-e097cd90-26df-410e-8442-d5d7d7cf6477 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:16:00.444678 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-e097cd90-26df-410e-8442-d5d7d7cf6477 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:16:00.445145 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-e097cd90-26df-410e-8442-d5d7d7cf6477 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:16:00.445866 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-e097cd90-26df-410e-8442-d5d7d7cf6477 admin admin] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:16:00.446319 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-e097cd90-26df-410e-8442-d5d7d7cf6477 admin admin] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:16:00.446747 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-e097cd90-26df-410e-8442-d5d7d7cf6477 admin admin] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:16:00.473381 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-e097cd90-26df-410e-8442-d5d7d7cf6477 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.086828 Oct 01 04:16:00.473868 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 38/74] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Oct 1 04:16:00 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:16:01.574493 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG nova.api.openstack.wsgi [None req-0cf606b3-cb4b-458c-a2e9-4304dbb5ca47 admin admin] Calling method '>' {{(pid=105604) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:16:01.575520 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: INFO nova.api.openstack.requestlog [None req-0cf606b3-cb4b-458c-a2e9-4304dbb5ca47 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 01 04:16:01.575920 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: [pid: 105604|app: 0|req: 37/75] 10.222.0.26 () {56 vars in 1074 bytes} [Sat Oct 1 04:16:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:16:01.769476 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG nova.api.openstack.wsgi [None req-78b2feeb-d0de-42db-8968-9040590d14a8 admin admin] Calling method '>' {{(pid=105605) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:16:01.773198 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-78b2feeb-d0de-42db-8968-9040590d14a8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:16:01.773670 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-78b2feeb-d0de-42db-8968-9040590d14a8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:16:01.774108 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-78b2feeb-d0de-42db-8968-9040590d14a8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:16:01.774821 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-78b2feeb-d0de-42db-8968-9040590d14a8 admin admin] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:16:01.775273 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-78b2feeb-d0de-42db-8968-9040590d14a8 admin admin] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:16:01.775693 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: DEBUG oslo_concurrency.lockutils [None req-78b2feeb-d0de-42db-8968-9040590d14a8 admin admin] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105605) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:16:01.797432 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: INFO nova.api.openstack.requestlog [None req-78b2feeb-d0de-42db-8968-9040590d14a8 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.082639 Oct 01 04:16:01.797987 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: [pid: 105605|app: 0|req: 39/76] 10.222.0.26 () {60 vars in 1193 bytes} [Sat Oct 1 04:16:01 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:16:58.389414 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: Sat Oct 1 04:16:58 2022 - graceful shutdown triggered... Oct 01 04:16:58.389926 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: Gracefully killing worker 1 (pid: 105604)... Oct 01 04:16:58.389547 dv-cinder-860044-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 01 04:16:58.390733 dv-cinder-860044-1-iscsi devstack@n-api.service[105605]: Gracefully killing worker 2 (pid: 105605)... Oct 01 04:16:58.516966 dv-cinder-860044-1-iscsi devstack@n-api.service[105604]: DEBUG dbcounter [-] [105604] Writing DB stats nova_api:SELECT=4 {{(pid=105604) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:16:59.390640 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: worker 1 buried after 1 seconds Oct 01 04:16:59.390640 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: worker 2 buried after 1 seconds Oct 01 04:16:59.390640 dv-cinder-860044-1-iscsi devstack@n-api.service[105603]: goodbye to uWSGI. Oct 01 04:16:59.392182 dv-cinder-860044-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 01 04:16:59.392731 dv-cinder-860044-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 01 04:16:59.396206 dv-cinder-860044-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 01 04:16:59.405943 dv-cinder-860044-1-iscsi devstack@n-api.service[120581]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 01 04:16:59.407859 dv-cinder-860044-1-iscsi devstack@n-api.service[120581]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 1 04:16:59 2022] *** Oct 01 04:16:59.408024 dv-cinder-860044-1-iscsi devstack@n-api.service[120581]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 01 04:16:59.408156 dv-cinder-860044-1-iscsi devstack@n-api.service[120581]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 01 04:16:59.408281 dv-cinder-860044-1-iscsi devstack@n-api.service[120581]: nodename: dv-cinder-860044-1-iscsi Oct 01 04:16:59.408392 dv-cinder-860044-1-iscsi devstack@n-api.service[120581]: machine: x86_64 Oct 01 04:16:59.408502 dv-cinder-860044-1-iscsi devstack@n-api.service[120581]: clock source: unix Oct 01 04:16:59.408623 dv-cinder-860044-1-iscsi devstack@n-api.service[120581]: pcre jit disabled Oct 01 04:16:59.408732 dv-cinder-860044-1-iscsi devstack@n-api.service[120581]: detected number of CPU cores: 4 Oct 01 04:16:59.408848 dv-cinder-860044-1-iscsi devstack@n-api.service[120581]: current working directory: / Oct 01 04:16:59.408987 dv-cinder-860044-1-iscsi devstack@n-api.service[120581]: detected binary path: /usr/bin/uwsgi-core Oct 01 04:16:59.409118 dv-cinder-860044-1-iscsi devstack@n-api.service[120581]: your processes number limit is 47680 Oct 01 04:16:59.409581 dv-cinder-860044-1-iscsi devstack@n-api.service[120581]: your memory page size is 4096 bytes Oct 01 04:16:59.409706 dv-cinder-860044-1-iscsi devstack@n-api.service[120581]: detected max file descriptor number: 2048 Oct 01 04:16:59.409821 dv-cinder-860044-1-iscsi devstack@n-api.service[120581]: lock engine: pthread robust mutexes Oct 01 04:16:59.410150 dv-cinder-860044-1-iscsi devstack@n-api.service[120581]: thunder lock: enabled Oct 01 04:16:59.410484 dv-cinder-860044-1-iscsi devstack@n-api.service[120581]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 01 04:16:59.410685 dv-cinder-860044-1-iscsi devstack@n-api.service[120581]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 01 04:16:59.451569 dv-cinder-860044-1-iscsi devstack@n-api.service[120581]: Python main interpreter initialized at 0x55944061b9c0 Oct 01 04:16:59.451569 dv-cinder-860044-1-iscsi devstack@n-api.service[120581]: python threads support enabled Oct 01 04:16:59.451569 dv-cinder-860044-1-iscsi devstack@n-api.service[120581]: your server socket listen backlog is limited to 100 connections Oct 01 04:16:59.451569 dv-cinder-860044-1-iscsi devstack@n-api.service[120581]: your mercy for graceful operations on workers is 90 seconds Oct 01 04:16:59.452003 dv-cinder-860044-1-iscsi devstack@n-api.service[120581]: mapped 403077 bytes (393 KB) for 2 cores Oct 01 04:16:59.452003 dv-cinder-860044-1-iscsi devstack@n-api.service[120581]: *** Operational MODE: preforking *** Oct 01 04:16:59.452280 dv-cinder-860044-1-iscsi devstack@n-api.service[120581]: *** uWSGI is running in multiple interpreter mode *** Oct 01 04:16:59.452280 dv-cinder-860044-1-iscsi devstack@n-api.service[120581]: spawned uWSGI master process (pid: 120581) Oct 01 04:16:59.452489 dv-cinder-860044-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 01 04:16:59.454954 dv-cinder-860044-1-iscsi devstack@n-api.service[120581]: spawned uWSGI worker 1 (pid: 120597, cores: 1) Oct 01 04:16:59.454954 dv-cinder-860044-1-iscsi devstack@n-api.service[120581]: spawned uWSGI worker 2 (pid: 120598, cores: 1) Oct 01 04:16:59.454954 dv-cinder-860044-1-iscsi devstack@n-api.service[120581]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 01 04:17:00.131998 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 01 04:17:00.137596 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 01 04:17:01.307187 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 01 04:17:01.307187 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: from cryptography.utils import int_from_bytes Oct 01 04:17:01.307859 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 01 04:17:01.307859 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: from cryptography.utils import int_from_bytes Oct 01 04:17:01.315480 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 01 04:17:01.315480 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: from cryptography.utils import int_from_bytes Oct 01 04:17:01.316049 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 01 04:17:01.316049 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: from cryptography.utils import int_from_bytes Oct 01 04:17:03.752642 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 01 04:17:03.754355 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 01 04:17:03.754355 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 01 04:17:03.754355 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 01 04:17:03.754588 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 01 04:17:03.754867 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.755198 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.755524 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.755861 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.756209 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.756532 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.756865 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.757437 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.757782 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.758051 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.758561 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.759238 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860044-1-iscsi {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.759583 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.759909 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.760236 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.760571 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.760890 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.761251 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.761569 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.762087 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.763484 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.763484 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.763484 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.763484 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.763807 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.764109 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.764440 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.764760 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.765122 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.765443 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.765863 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860044-1-iscsi {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.766194 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.766516 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.766839 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.767277 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.767600 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.767923 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.768255 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.769195 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.769515 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.769868 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.770187 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.770513 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.770844 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.771159 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.771479 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.771797 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.772125 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.772440 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.772754 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.773042 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.773362 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.773693 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.774023 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.774357 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.774616 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.774873 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.775205 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.775524 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.775842 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.776161 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.776476 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.776793 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.777138 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.777725 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.778042 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.778365 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.778696 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.779020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.779352 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.779671 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.780001 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.780421 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.780681 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.781027 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.781382 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.781712 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.782031 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.782360 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.782690 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.783010 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.783329 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.783646 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.783978 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.784389 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.784713 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.785113 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.785434 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.785754 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.786087 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.786408 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.786727 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.787047 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.787360 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.787679 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.787999 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.788330 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.788639 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.789005 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.789298 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.789615 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.789936 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.790254 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.790570 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.790903 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.791238 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.791856 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.791856 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.792176 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.792491 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.792821 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.793167 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.793484 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.793818 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.794137 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.794454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.794783 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.795099 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.795417 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.795748 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.796060 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.796376 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.796702 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.797040 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.797358 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.797673 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.797987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.798307 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.798624 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.798934 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.799247 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.799557 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.800105 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.800523 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.800849 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.801198 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.801519 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.801851 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.802203 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.802548 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.802904 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.803231 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.803575 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.803705 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 01 04:17:03.804169 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.804300 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 01 04:17:03.804443 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.804581 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 01 04:17:03.804711 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.804842 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 01 04:17:03.805003 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.805134 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 01 04:17:03.805276 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.805497 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.805641 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.805826 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.805963 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.806150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.806296 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.806473 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.806602 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.806870 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.807021 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.807170 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.807308 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.807437 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.807572 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.807738 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.807871 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.808072 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.808212 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.808363 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.808584 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.808790 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.808950 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.809099 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.809236 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-860044-1-iscsi {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.809365 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.809548 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.809689 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.809867 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.810090 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.810242 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.810370 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.810504 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.810694 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.810834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.811033 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.811170 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.811368 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.811506 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.811693 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.811912 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.812060 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.812231 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.812364 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.812544 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.812688 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.812862 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.813040 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.813230 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.813368 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.813551 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.813770 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.813901 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.814028 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.814183 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.814321 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.814499 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.814648 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.814829 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.814968 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.815145 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.815884 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.816111 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.816243 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-860044-1-iscsi {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.816365 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.816567 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.816701 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.816901 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.817066 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.817251 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.817384 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.817625 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.817754 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.817952 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.818083 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.818281 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.818420 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.818648 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.818811 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.819014 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.819145 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.819269 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.819393 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.819529 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.819663 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.819832 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.819970 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.820198 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.820345 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.820486 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.820628 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.820764 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.820892 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.821107 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.821251 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.821419 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.821564 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.821745 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.821886 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.822056 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.822196 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.822365 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.822509 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.822645 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.822783 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.822917 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.823044 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.823231 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.823371 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.823556 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.823687 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.823882 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.824026 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.824162 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.824300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.824435 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.824564 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.824690 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.824847 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.825026 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.825197 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.825329 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.825516 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.825649 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.825875 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.826013 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.826147 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.826276 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.826465 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.826597 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.826835 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.826988 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.827122 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.827254 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.827390 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.827527 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.827712 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.827846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.828030 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.828169 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.828374 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.828511 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.828655 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.828877 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.829107 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.829251 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.829387 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.829522 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.829651 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.829777 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.829904 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.830037 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.830310 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.830466 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.830603 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.830732 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.830939 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.831647 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.831834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.831959 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.832144 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.832283 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.832418 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.832560 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.832699 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.832836 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.833007 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.833139 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.833299 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.833446 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.833642 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.833777 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.833953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.834091 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.834225 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.834361 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.834504 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.834642 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.834801 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.834932 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.835126 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.835256 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.835439 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.835584 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.835751 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.835882 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.836053 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.836191 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.836358 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.836504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.836672 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.836804 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.837067 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.837203 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.837345 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.837491 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.837628 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.837766 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.837894 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.838022 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.838202 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.838348 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.838514 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.838656 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.838831 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.839080 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.839290 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.839434 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.839571 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.839700 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.839834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.839969 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.840109 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.840245 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.840387 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.840586 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.840727 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.840863 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.841092 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.841232 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.841369 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.841515 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.841654 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.841816 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.841959 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.842137 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.842276 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.842471 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.842604 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.842790 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.842936 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.843100 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.843231 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.843427 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.843567 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.843742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.843882 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.844057 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.844202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.844382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.844514 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.844690 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.844831 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.845014 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.845159 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.845336 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.845468 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.845650 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.845783 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.845964 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.846135 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.846259 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.846377 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.846596 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.846781 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.846926 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.847139 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.847280 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.847408 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.847542 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.847674 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.847815 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.847946 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.848082 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.848272 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.848412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.848601 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.848742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.848917 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.849085 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.849321 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.849514 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.849654 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.849791 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.849919 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.850059 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 01 04:17:03.850233 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.850364 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.850623 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.850777 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.850906 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.851041 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.851196 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.851349 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.852020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.852169 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.852308 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.852443 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.852580 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.852715 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.852858 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.853036 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.853177 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.853305 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.853432 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.853566 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.853703 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.853840 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.853969 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.854104 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.854234 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.854368 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.854505 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.854633 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.854761 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.854895 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.855033 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.855174 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.855311 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.855447 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.855583 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.855712 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.855839 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.855974 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.856149 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.856281 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.856455 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.856586 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.856790 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.856951 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.857133 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.857274 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.857450 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.857592 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.857784 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.857928 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.858112 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.858244 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.858431 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.858570 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.858746 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.858885 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.859061 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.859200 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.859377 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.859523 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.859725 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.859863 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.860013 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.860224 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.860355 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.860482 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.860624 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.860839 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.861013 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.861141 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.861279 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.861414 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.861556 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.861683 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.861888 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.862017 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.862252 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.862392 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.862577 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.862789 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.862917 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.863201 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.863335 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.863519 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.863650 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.863845 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.863972 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.864169 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.864295 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.864492 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.864619 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.864814 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.864970 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.865160 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.865289 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.865482 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.865618 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.865800 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.865928 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.866117 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.866289 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.866426 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.866558 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.866732 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.866866 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.867049 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.867338 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.867468 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.867665 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.867794 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.867975 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.868114 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.868302 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.868434 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.868638 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.868770 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.868973 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.869187 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.869322 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.869451 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.869619 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.869846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.869973 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.870100 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.870242 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.870452 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.870592 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.870730 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.870879 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.871071 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.871204 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.871340 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.871468 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.871605 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.871759 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.871889 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.872090 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.872229 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.872409 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.872559 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.872723 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.872853 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.873061 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.873206 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.873378 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.873499 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.873690 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.873828 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.874003 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.874140 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.874319 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.874448 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.874633 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.874762 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.874948 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.875083 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.875262 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.875391 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.875587 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.875717 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.875905 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.876045 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.876223 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.876393 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.876523 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.876650 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.876842 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.877000 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.877212 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.877342 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.877530 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.877657 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.878378 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.878528 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.878705 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.878833 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.879017 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.879148 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.879335 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.879478 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.879648 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.879787 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.879995 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.880128 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.880268 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.880404 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.880627 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.880763 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.880891 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.881065 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.881270 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.881411 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.881548 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.881676 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.881810 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.881944 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.882080 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.882238 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.882370 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.882559 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.882700 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.882881 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.883027 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.883206 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.883336 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.883523 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.883663 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.883845 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.883985 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.884160 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.884298 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.884487 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.884620 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.884811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.884965 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.885153 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.885284 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.885471 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.885608 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.885787 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.885927 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.886108 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.886247 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.886416 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.886546 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.886730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.886868 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.887041 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.887180 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.887358 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.887489 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.887673 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.887804 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.887989 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.888121 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.888303 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.888444 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.888620 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.888756 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.889503 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.889648 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.889779 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.889924 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.889924 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.890258 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.890388 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.890515 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.890671 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.890891 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.890891 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.891139 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.891283 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.891481 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.891621 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.891750 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.891886 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.892023 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.892151 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.892278 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.892414 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.892551 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.892687 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.892815 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.892969 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.893112 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.893255 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.893430 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.894083 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.894207 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.894207 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.894422 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.894578 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.894717 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.894846 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.894973 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.895109 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.895252 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.895388 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.895516 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.895682 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.895824 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.896008 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.896150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.896320 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.896492 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.896623 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.896751 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.896989 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.897142 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.897333 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.897452 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.897656 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.897776 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.897975 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.898137 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.898300 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.898430 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.898717 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.898863 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.899004 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.899141 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.899285 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.899417 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.899554 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.899690 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.899832 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.899962 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.900113 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.900313 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.900453 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.900580 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.900715 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.900904 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.901130 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.901262 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.901403 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.901614 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.901827 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.901966 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.902106 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.902235 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.902620 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.902749 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.902889 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.903026 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.903162 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.903297 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.903426 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.903597 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.903731 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.903918 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.904056 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.904251 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.904382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.904583 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.904837 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.905015 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.905183 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.905314 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.905516 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.905662 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.905835 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.905976 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.906148 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.906281 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.906460 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.906646 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.906786 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.906923 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.907087 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.907217 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.907410 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.907535 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.907728 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.907871 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.908087 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.908216 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.908354 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.908483 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.908664 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.908798 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.909030 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.909164 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.909359 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.909478 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.909759 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.909902 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.910099 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.910232 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.910447 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.910580 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.910732 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.910865 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.911053 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.911287 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.911420 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.911557 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.911762 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.911902 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.912037 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.912175 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.912303 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.912457 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.912589 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.912783 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.912962 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.913198 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.913339 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.913520 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.913651 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.913840 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.913970 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.914162 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.914292 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.914494 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.914739 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.914878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.915080 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.915220 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.915402 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.915544 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.915730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.915870 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.916085 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.916219 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.916410 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.916543 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.916746 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.916879 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.917096 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.917239 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.917415 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.917558 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.917733 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.917864 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.918126 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.918259 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.918388 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.918524 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.918661 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.918797 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.918962 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.919094 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.919275 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.919417 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.919586 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.919718 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.919894 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.920033 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.920210 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.920352 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.920555 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.920686 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.920818 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.921069 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.921214 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.921437 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.921577 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.921706 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.921915 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.922054 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.922192 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.922329 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.922459 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.922646 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.922777 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.922966 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.923177 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.923309 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.923436 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.923571 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.923708 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.923879 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.924020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.924190 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.924314 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.924541 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.924728 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.924916 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.925202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.925328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.925500 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.925635 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.925843 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.925991 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.926184 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.926330 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.926515 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.926649 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.926855 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.926999 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.927168 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.927299 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.927480 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.927622 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.927794 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.927934 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.928113 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.928366 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.928499 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.928627 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.928766 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.928896 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.929067 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.929196 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.929357 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.929522 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.929669 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.929844 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.929985 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.930162 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.930301 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.930496 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.930723 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.930859 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.930987 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.931122 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.931251 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.931517 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.931679 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.931810 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.931953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.932152 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.932285 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.932423 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.932552 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.932688 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.932825 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.933002 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.933145 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.933322 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.933463 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.933635 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.933775 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.933958 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.934091 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.934272 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.934412 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.934584 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.934725 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.934897 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.935033 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.935215 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.935358 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.935528 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.935658 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.935838 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.935982 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.936152 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.936290 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.936475 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.936605 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.936820 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.936998 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.937131 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.937260 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.937428 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.937568 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.937744 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.937886 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.938056 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.938188 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.938408 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.938555 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.938685 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.938823 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.939011 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.939153 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.939322 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.939455 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.939641 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.939775 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.939953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.940085 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.940822 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.941437 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.941437 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.941632 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.941717 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.941805 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.941890 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.942016 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.942187 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.942389 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.942529 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.942659 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.942788 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.942923 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.943061 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.943233 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.943376 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.943565 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.943697 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.943886 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.944020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.944201 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.944333 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.944514 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.944646 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.944825 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.944992 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.945203 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.945355 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.945574 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.945712 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.945850 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.945979 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.946156 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.946297 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.946473 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.946607 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.946796 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.946969 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.947103 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.947239 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.947427 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.947561 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.947750 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.947890 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.948063 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.948194 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.948388 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.948603 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.948735 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.948869 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.949026 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.949174 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.949330 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.949463 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.949641 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.949775 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.949967 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.950108 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.950288 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.950428 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.950605 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.950739 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.950935 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.951060 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.951264 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.951477 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.951580 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.951818 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.951934 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.952147 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.952250 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.952476 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.952586 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.952800 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.952901 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.953142 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.953245 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.953462 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.953564 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.953783 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.953900 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.954103 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.954210 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.954416 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.954524 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.954736 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.954847 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.955054 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.955156 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.955368 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.955488 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.955687 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.955809 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.956630 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.957138 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.957138 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.957313 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.957410 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.957498 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.957591 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.957712 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.957911 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.958049 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.958281 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.958416 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.958637 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.958788 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.958919 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.959058 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.959239 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.959371 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.959568 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.959707 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.959892 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.960034 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.960214 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.960354 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.960538 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.960670 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.960861 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.961101 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.961236 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.961390 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.961521 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.961651 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.961915 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.962072 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.962213 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.962351 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.962495 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.962683 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.962830 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.962960 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.963132 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.963276 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.963511 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.963651 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.963790 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.963918 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.964068 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.964200 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.964386 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.964519 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.964715 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.964956 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.965092 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.965281 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.965417 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.965625 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.965778 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.965956 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.966089 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.966267 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.966398 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.966594 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.966727 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.966920 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.967100 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.967258 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.967392 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.967577 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.967710 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.967893 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.968035 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.968215 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.968355 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.968538 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.968686 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.968890 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.969062 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.969193 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.969331 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.969514 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.969647 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.969831 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.969972 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.970161 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.970302 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.970480 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.970614 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.970839 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.971031 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.971239 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.971380 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.971535 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.971820 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.971980 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.972252 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.972388 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.972527 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.972681 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.972882 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.973043 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.973182 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.973326 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.973456 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.973627 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.973831 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.973964 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.974165 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.974312 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.974489 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.974622 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.974821 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.974965 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.975155 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.975296 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.975471 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.975604 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.975822 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.975964 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.976094 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.976307 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.976446 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.976575 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.976710 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.976846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.977024 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.977190 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.977328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.977455 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.977640 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.977781 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.977959 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.978106 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.978272 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.978402 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.978586 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.978717 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.978927 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.979076 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.979206 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.979332 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.979510 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.979644 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.979827 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.979960 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.980145 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.980283 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.980455 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.980599 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.980790 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.980920 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.981128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.981274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.981465 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.981610 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.981762 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.981894 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.982076 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.982232 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.982442 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.982584 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.982713 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.982863 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.983060 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.983201 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.983331 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.983475 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.983635 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.983768 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.983972 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.984106 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.984308 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.984442 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.984626 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.984756 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.984966 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.985114 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.985314 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.985447 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.985640 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.985771 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.985958 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.986189 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.986331 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.986537 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.986676 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.986869 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.987002 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.987243 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.987426 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.987607 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.987864 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.988010 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.988140 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.988279 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.988409 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.988538 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.988673 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.988801 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.988952 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.989157 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.989300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.989438 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.989577 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.989714 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.989880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.990022 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.990205 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.990352 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.990528 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.990661 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.990849 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.990992 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.991174 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.991315 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.991635 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.991772 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.991914 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.992041 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.992176 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.992304 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.992453 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.992663 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.992805 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.992989 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.993165 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.993297 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.993437 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.993568 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.993707 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.993845 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.994011 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.994155 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.994339 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.994484 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.994664 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.994798 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.994987 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.995119 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.995309 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.995451 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.995628 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.995763 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.995943 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.996080 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.996261 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.996402 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.996581 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.996712 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.996904 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.997057 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.997295 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.997449 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.997580 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.997781 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.997916 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.998104 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.998311 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.998452 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.998634 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.998773 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.998971 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.999118 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.999323 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.999456 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.999594 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.999732 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:03.999925 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.000067 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.000257 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.000400 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.000574 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.000705 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.000901 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.001087 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.001244 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.001385 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.001575 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.001846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.001980 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.002110 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.002239 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.002368 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.002532 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.002679 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.003500 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.003648 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.003779 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.003907 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.004044 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.004184 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.004327 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.004463 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.004634 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.004774 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.004980 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.005104 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.005308 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.005424 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.005629 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.005733 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.005945 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.006133 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.006264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.006411 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.006578 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.006719 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.006889 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.007033 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.007202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.007374 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.007521 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.007658 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.007816 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.007960 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.008127 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.008251 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.008439 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.008579 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.008751 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.008895 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.009091 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.009236 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.009448 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.009589 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.009728 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.009858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.010010 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.010142 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.010323 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.010635 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.010778 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.010947 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.011080 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.011258 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.012083 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.012220 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.012363 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.012499 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.012636 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.012771 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.012899 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.013065 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.013209 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.013339 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.013574 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.013708 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.013836 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.013974 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.014111 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.014241 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.014369 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.014497 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.014625 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.014767 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.014904 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.015033 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.015161 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.015161 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.015411 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.015553 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.015684 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.015819 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.015949 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.016085 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.016221 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.016359 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.016513 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.016647 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.016870 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.017026 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.017220 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.017361 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.017556 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.017690 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.017890 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.018034 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.018216 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.018367 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.019078 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.019214 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.019495 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.019623 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.019843 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.019977 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.020163 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.020293 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.020489 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.020635 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.020809 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.021001 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.021146 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.021264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.021446 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.021587 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.021765 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.021899 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.022162 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.022297 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.022425 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.022555 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.022684 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.022812 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.022981 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.023122 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.023315 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.023453 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.023609 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.023826 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.023959 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.024095 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.024233 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.024362 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.024531 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.024663 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.024844 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.025003 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.025179 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.025321 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.025494 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.025635 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.025806 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.025947 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.026126 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.026282 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.026421 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.026615 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.026822 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.026967 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.027134 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.027275 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.027693 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.027829 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.028041 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120597) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 01 04:17:04.028182 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.028358 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.028669 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.029026 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.029378 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.030508 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.030508 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.030508 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.030817 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.030906 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.031180 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.031533 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.031856 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.032405 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.032751 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.033102 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.033450 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.033793 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.034219 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.034668 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.034814 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.035148 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.035471 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.035794 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.036113 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.036431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.036753 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.037091 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.037411 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.037730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.038047 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.038363 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.038679 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.039002 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.039324 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.039639 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.039961 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.040311 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.040638 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.040982 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.041309 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.041635 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.041954 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.042275 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.042593 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.042913 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.043232 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.043568 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.043891 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.044203 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.044629 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.044964 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.045293 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.045620 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.045941 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.046267 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.046594 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.046915 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.047242 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.047557 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.047893 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.048235 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.048571 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.048905 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.049241 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.049571 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.050403 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.050721 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.051049 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.051364 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.051674 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.051980 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.052295 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.052606 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.052916 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.053244 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.053557 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.054008 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.054324 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.054631 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.054941 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.055250 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.055560 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.055868 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.056182 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.056496 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.056808 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.057142 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.057451 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.057757 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.058095 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.058432 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.058753 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.059083 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.059407 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.059737 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.060055 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.060384 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.060713 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.061060 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.061377 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.061719 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.062041 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.062360 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.062681 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.062997 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.063316 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.063633 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.063968 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.064302 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.064616 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.064962 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.065401 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.066244 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.066573 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.066893 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.067231 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.067549 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.067873 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.068192 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.068512 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.068831 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.069180 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.069503 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.069822 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.070145 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.070470 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.070803 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.071136 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.071456 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.071788 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.072121 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.072471 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.072790 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.073165 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.073503 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.073830 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.074146 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.074462 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 01 04:17:04.074711 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120598) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 01 04:17:04.089735 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO dbcounter [None req-d73a114f-c7de-494a-ae9a-403eb70a4771 None None] Registered counter for database nova_api Oct 01 04:17:04.110128 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_db.sqlalchemy.engines [None req-d73a114f-c7de-494a-ae9a-403eb70a4771 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120597) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 04:17:04.117459 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writer thread running {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 04:17:04.136424 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO dbcounter [None req-0ad84665-e4eb-41a1-9dd7-3713c784aaaa None None] Registered counter for database nova_api Oct 01 04:17:04.157188 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_db.sqlalchemy.engines [None req-0ad84665-e4eb-41a1-9dd7-3713c784aaaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 04:17:04.165096 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writer thread running {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 04:17:04.176066 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.context [None req-d73a114f-c7de-494a-ae9a-403eb70a4771 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6637a42c-607b-4146-a74a-010d94c4cfd5(cell1) {{(pid=120597) load_cells /opt/stack/nova/nova/context.py:464}} Oct 01 04:17:04.180119 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d73a114f-c7de-494a-ae9a-403eb70a4771 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:17:04.180606 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d73a114f-c7de-494a-ae9a-403eb70a4771 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:17:04.182243 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d73a114f-c7de-494a-ae9a-403eb70a4771 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:17:04.182997 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d73a114f-c7de-494a-ae9a-403eb70a4771 None None] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:17:04.183454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d73a114f-c7de-494a-ae9a-403eb70a4771 None None] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:17:04.185507 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d73a114f-c7de-494a-ae9a-403eb70a4771 None None] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:17:04.187495 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO dbcounter [None req-d73a114f-c7de-494a-ae9a-403eb70a4771 None None] Registered counter for database nova_cell0 Oct 01 04:17:04.192345 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO dbcounter [None req-d73a114f-c7de-494a-ae9a-403eb70a4771 None None] Registered counter for database nova_cell1 Oct 01 04:17:04.200246 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_db.sqlalchemy.engines [None req-d73a114f-c7de-494a-ae9a-403eb70a4771 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120597) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 04:17:04.201479 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_db.sqlalchemy.engines [None req-d73a114f-c7de-494a-ae9a-403eb70a4771 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120597) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 04:17:04.208185 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writer thread running {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 04:17:04.209565 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writer thread running {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 04:17:04.226677 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.context [None req-0ad84665-e4eb-41a1-9dd7-3713c784aaaa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6637a42c-607b-4146-a74a-010d94c4cfd5(cell1) {{(pid=120598) load_cells /opt/stack/nova/nova/context.py:464}} Oct 01 04:17:04.230689 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ad84665-e4eb-41a1-9dd7-3713c784aaaa None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:17:04.231179 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ad84665-e4eb-41a1-9dd7-3713c784aaaa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:17:04.232792 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ad84665-e4eb-41a1-9dd7-3713c784aaaa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:17:04.233578 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ad84665-e4eb-41a1-9dd7-3713c784aaaa None None] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:17:04.234036 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ad84665-e4eb-41a1-9dd7-3713c784aaaa None None] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:17:04.236190 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ad84665-e4eb-41a1-9dd7-3713c784aaaa None None] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:17:04.239265 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO dbcounter [None req-0ad84665-e4eb-41a1-9dd7-3713c784aaaa None None] Registered counter for database nova_cell0 Oct 01 04:17:04.243406 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO dbcounter [None req-0ad84665-e4eb-41a1-9dd7-3713c784aaaa None None] Registered counter for database nova_cell1 Oct 01 04:17:04.250765 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_db.sqlalchemy.engines [None req-0ad84665-e4eb-41a1-9dd7-3713c784aaaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 04:17:04.253724 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_db.sqlalchemy.engines [None req-0ad84665-e4eb-41a1-9dd7-3713c784aaaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 04:17:04.259564 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writer thread running {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 04:17:04.260868 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writer thread running {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 04:17:04.359343 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO dbcounter [None req-d73a114f-c7de-494a-ae9a-403eb70a4771 None None] Registered counter for database nova_cell0 Oct 01 04:17:04.367223 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_db.sqlalchemy.engines [None req-d73a114f-c7de-494a-ae9a-403eb70a4771 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120597) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 04:17:04.372052 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writer thread running {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 04:17:04.416128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO dbcounter [None req-0ad84665-e4eb-41a1-9dd7-3713c784aaaa None None] Registered counter for database nova_cell0 Oct 01 04:17:04.423018 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_db.sqlalchemy.engines [None req-0ad84665-e4eb-41a1-9dd7-3713c784aaaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120598) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 01 04:17:04.427917 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writer thread running {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 01 04:17:04.701381 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: WARNING keystonemiddleware.auth_token [None req-d73a114f-c7de-494a-ae9a-403eb70a4771 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 01 04:17:04.709395 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: WARNING keystonemiddleware.auth_token [None req-d73a114f-c7de-494a-ae9a-403eb70a4771 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 01 04:17:04.752537 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: WARNING keystonemiddleware.auth_token [None req-0ad84665-e4eb-41a1-9dd7-3713c784aaaa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 01 04:17:04.763320 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: WARNING keystonemiddleware.auth_token [None req-0ad84665-e4eb-41a1-9dd7-3713c784aaaa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 01 04:17:05.056153 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: WARNING keystonemiddleware.auth_token [None req-d73a114f-c7de-494a-ae9a-403eb70a4771 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 01 04:17:05.062210 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: WARNING keystonemiddleware.auth_token [None req-d73a114f-c7de-494a-ae9a-403eb70a4771 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 01 04:17:05.068234 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55944061b9c0 pid: 120597 (default app) Oct 01 04:17:05.107938 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: WARNING keystonemiddleware.auth_token [None req-0ad84665-e4eb-41a1-9dd7-3713c784aaaa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 01 04:17:05.114684 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: WARNING keystonemiddleware.auth_token [None req-0ad84665-e4eb-41a1-9dd7-3713c784aaaa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 01 04:17:05.120021 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55944061b9c0 pid: 120598 (default app) Oct 01 04:17:39.877011 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:39.878928 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:39.879909 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:39.881196 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:40.918313 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b08e89ac-61b7-4b63-b692-2e9ea976315e tempest-VolumesNegativeTest-594124078 tempest-VolumesNegativeTest-594124078-project] Action: 'create', calling method: .version_select at 0x7fdfbf8634c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-826571304", "metadata": {"Type": "work"}}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:17:40.929846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b08e89ac-61b7-4b63-b692-2e9ea976315e tempest-VolumesNegativeTest-594124078 tempest-VolumesNegativeTest-594124078-project] Request method failure captured: Oct 01 04:17:40.929846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 01 04:17:40.929846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept: application/json Oct 01 04:17:40.929846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept-Encoding: identity Oct 01 04:17:40.929846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Connection: close Oct 01 04:17:40.929846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Length: 121 Oct 01 04:17:40.929846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Type: application/json Oct 01 04:17:40.929846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Host: 10.222.0.26 Oct 01 04:17:40.929846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 01 04:17:40.929846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 01 04:17:40.929846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjN79jo6WCLOHfxaXjp8InQWJPt_wxcqOfRUDc7RPrpletjCxlw3YbvDrvILp2YuI2gp9KLexgmO8NBHyDgSmA_-CPtFOpkq55cEFuoHrtZMiWsOAYRciOXNV20Jnq8GrKIz6OgyJgwGDRfwoLDHMcea_Q0vU6oKwqmPyuo2td3NGeKj4 Oct 01 04:17:40.929846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Id: None Oct 01 04:17:40.929846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Name: None Oct 01 04:17:40.929846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 01 04:17:40.929846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 01 04:17:40.929846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 01 04:17:40.929846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 01 04:17:40.929846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Id: 3ebfba30505f48c181cb04960d38aa63 Oct 01 04:17:40.929846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Name: tempest-VolumesNegativeTest-594124078 Oct 01 04:17:40.929846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Role: reader,member Oct 01 04:17:40.929846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Roles: reader,member Oct 01 04:17:40.931415 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3ebfba30505f48c181cb04960d38aa63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ebfba30505f48c181cb04960d38aa63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ebfba30505f48c181cb04960d38aa63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3ebfba30505f48c181cb04960d38aa63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:17:40.931415 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant: tempest-VolumesNegativeTest-594124078 Oct 01 04:17:40.931415 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Id: 3ebfba30505f48c181cb04960d38aa63 Oct 01 04:17:40.931415 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Name: tempest-VolumesNegativeTest-594124078 Oct 01 04:17:40.931415 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User: tempest-VolumesNegativeTest-594124078-project Oct 01 04:17:40.931415 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 01 04:17:40.931415 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 01 04:17:40.931415 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Id: d7e1763c88334c29a14bb192bfe32bb2 Oct 01 04:17:40.931415 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Name: tempest-VolumesNegativeTest-594124078-project Oct 01 04:17:40.931415 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Oct 01 04:17:40.931415 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-826571304", "metadata": {"Type": "work"}}} Oct 01 04:17:40.931415 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: method: Oct 01 04:17:40.931415 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 01 04:17:40.932274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-826571304', 'metadata': {'Type': 'work'}}}} Oct 01 04:17:40.932274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:17:40.932274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:17:40.932274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 04:17:40.932274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 04:17:40.932274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 04:17:40.932274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise error Oct 01 04:17:40.932274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 01 04:17:40.932274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:17:40.932274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 01 04:17:40.932274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 01 04:17:40.932274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:17:40.932274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 01 04:17:40.932274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi '#$%' Oct 01 04:17:40.932274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:17:40.932274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:17:40.932274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:17:40.932274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:17:40.932274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:17:40.932274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:17:40.932274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:17:40.932274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:17:40.933653 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 04:17:40.933653 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 04:17:40.933653 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:17:40.933653 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:17:40.933653 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 04:17:40.933653 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 04:17:40.933653 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 04:17:40.933653 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 04:17:40.933653 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 04:17:40.933653 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 04:17:40.933653 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 01 04:17:40.933653 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:17:40.933653 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:17:40.933653 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:17:40.933653 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:17:40.933653 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:17:40.933653 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:17:40.933653 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 04:17:40.933653 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 04:17:40.934863 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 01 04:17:40.934863 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:17:40.934863 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b08e89ac-61b7-4b63-b692-2e9ea976315e tempest-VolumesNegativeTest-594124078 tempest-VolumesNegativeTest-594124078-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:17:40.934863 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b08e89ac-61b7-4b63-b692-2e9ea976315e tempest-VolumesNegativeTest-594124078 tempest-VolumesNegativeTest-594124078-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.064571 Oct 01 04:17:40.934863 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Oct 1 04:17:39 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1068 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 04:17:41.159633 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-81cf94d5-067c-4dc7-93db-9f04039c8e7a tempest-VolumesNegativeTest-594124078 tempest-VolumesNegativeTest-594124078-project] Action: 'create', calling method: .version_select at 0x7fdfbf90ef70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1176623498", "metadata": {"Type": "work"}}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:17:41.165838 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-81cf94d5-067c-4dc7-93db-9f04039c8e7a tempest-VolumesNegativeTest-594124078 tempest-VolumesNegativeTest-594124078-project] Request method failure captured: Oct 01 04:17:41.165838 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 01 04:17:41.165838 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:17:41.165838 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:17:41.165838 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:17:41.165838 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 120 Oct 01 04:17:41.165838 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:17:41.165838 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:17:41.165838 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:17:41.165838 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:17:41.165838 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN79jo6WCLOHfxaXjp8InQWJPt_wxcqOfRUDc7RPrpletjCxlw3YbvDrvILp2YuI2gp9KLexgmO8NBHyDgSmA_-CPtFOpkq55cEFuoHrtZMiWsOAYRciOXNV20Jnq8GrKIz6OgyJgwGDRfwoLDHMcea_Q0vU6oKwqmPyuo2td3NGeKj4 Oct 01 04:17:41.165838 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:17:41.165838 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:17:41.165838 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:17:41.165838 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:17:41.165838 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:17:41.165838 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:17:41.165838 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: 3ebfba30505f48c181cb04960d38aa63 Oct 01 04:17:41.165838 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-VolumesNegativeTest-594124078 Oct 01 04:17:41.165838 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:17:41.165838 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:17:41.167433 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3ebfba30505f48c181cb04960d38aa63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ebfba30505f48c181cb04960d38aa63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ebfba30505f48c181cb04960d38aa63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3ebfba30505f48c181cb04960d38aa63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:17:41.167433 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-VolumesNegativeTest-594124078 Oct 01 04:17:41.167433 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 3ebfba30505f48c181cb04960d38aa63 Oct 01 04:17:41.167433 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-VolumesNegativeTest-594124078 Oct 01 04:17:41.167433 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-VolumesNegativeTest-594124078-project Oct 01 04:17:41.167433 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:17:41.167433 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:17:41.167433 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: d7e1763c88334c29a14bb192bfe32bb2 Oct 01 04:17:41.167433 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-VolumesNegativeTest-594124078-project Oct 01 04:17:41.167433 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Oct 01 04:17:41.167433 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1176623498", "metadata": {"Type": "work"}}} Oct 01 04:17:41.167433 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: Oct 01 04:17:41.167433 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 01 04:17:41.168382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1176623498', 'metadata': {'Type': 'work'}}}} Oct 01 04:17:41.168382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:17:41.168382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:17:41.168382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 04:17:41.168382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 04:17:41.168382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 04:17:41.168382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise error Oct 01 04:17:41.168382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 01 04:17:41.168382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:41.168382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 01 04:17:41.168382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 01 04:17:41.168382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:41.168382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 01 04:17:41.168382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi '0' Oct 01 04:17:41.168382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:41.168382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:17:41.168382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:41.168382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:17:41.168382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:17:41.168382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:17:41.168382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:17:41.168382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:17:41.170031 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 04:17:41.170031 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 04:17:41.170031 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:17:41.170031 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:17:41.170031 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 04:17:41.170031 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 04:17:41.170031 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 04:17:41.170031 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 04:17:41.170031 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 04:17:41.170031 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 04:17:41.170031 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 01 04:17:41.170031 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:41.170031 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:17:41.170031 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:41.170031 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:17:41.170031 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:17:41.170031 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:17:41.170031 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 04:17:41.170031 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 04:17:41.171996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 01 04:17:41.171996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:41.171996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-81cf94d5-067c-4dc7-93db-9f04039c8e7a tempest-VolumesNegativeTest-594124078 tempest-VolumesNegativeTest-594124078-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:17:41.171996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-81cf94d5-067c-4dc7-93db-9f04039c8e7a tempest-VolumesNegativeTest-594124078 tempest-VolumesNegativeTest-594124078-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.229332 Oct 01 04:17:41.171996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 1/2] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Oct 1 04:17:40 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 233 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 04:17:41.182745 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-09c79345-2015-41f8-b992-7380e1883793 tempest-VolumesNegativeTest-594124078 tempest-VolumesNegativeTest-594124078-project] Action: 'create', calling method: .version_select at 0x7fdfbf89caf0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1930028414", "metadata": {"Type": "work"}}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:17:41.186931 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-09c79345-2015-41f8-b992-7380e1883793 tempest-VolumesNegativeTest-594124078 tempest-VolumesNegativeTest-594124078-project] Request method failure captured: Oct 01 04:17:41.186931 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 01 04:17:41.186931 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:17:41.186931 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:17:41.186931 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:17:41.186931 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 119 Oct 01 04:17:41.186931 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:17:41.186931 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:17:41.186931 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:17:41.186931 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:17:41.186931 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN79jo6WCLOHfxaXjp8InQWJPt_wxcqOfRUDc7RPrpletjCxlw3YbvDrvILp2YuI2gp9KLexgmO8NBHyDgSmA_-CPtFOpkq55cEFuoHrtZMiWsOAYRciOXNV20Jnq8GrKIz6OgyJgwGDRfwoLDHMcea_Q0vU6oKwqmPyuo2td3NGeKj4 Oct 01 04:17:41.186931 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:17:41.186931 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:17:41.186931 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:17:41.186931 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:17:41.186931 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:17:41.186931 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:17:41.186931 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: 3ebfba30505f48c181cb04960d38aa63 Oct 01 04:17:41.186931 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-VolumesNegativeTest-594124078 Oct 01 04:17:41.186931 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:17:41.186931 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:17:41.188237 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3ebfba30505f48c181cb04960d38aa63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ebfba30505f48c181cb04960d38aa63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ebfba30505f48c181cb04960d38aa63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3ebfba30505f48c181cb04960d38aa63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:17:41.188237 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-VolumesNegativeTest-594124078 Oct 01 04:17:41.188237 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 3ebfba30505f48c181cb04960d38aa63 Oct 01 04:17:41.188237 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-VolumesNegativeTest-594124078 Oct 01 04:17:41.188237 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-VolumesNegativeTest-594124078-project Oct 01 04:17:41.188237 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:17:41.188237 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:17:41.188237 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: d7e1763c88334c29a14bb192bfe32bb2 Oct 01 04:17:41.188237 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-VolumesNegativeTest-594124078-project Oct 01 04:17:41.188237 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Oct 01 04:17:41.188237 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1930028414", "metadata": {"Type": "work"}}} Oct 01 04:17:41.188237 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: Oct 01 04:17:41.188237 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 01 04:17:41.194075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1930028414', 'metadata': {'Type': 'work'}}}} Oct 01 04:17:41.194075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:17:41.194075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:17:41.194075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 01 04:17:41.194075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 01 04:17:41.194075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 01 04:17:41.194075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise error Oct 01 04:17:41.194075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 01 04:17:41.194075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:41.194075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 01 04:17:41.194075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 01 04:17:41.194075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:41.194075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 01 04:17:41.194075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi '' Oct 01 04:17:41.194075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:41.194075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:17:41.194075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:41.194075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:17:41.194075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:17:41.194075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:17:41.194075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:17:41.194075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:17:41.195460 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 04:17:41.195460 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 04:17:41.195460 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:17:41.195460 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:17:41.195460 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 01 04:17:41.195460 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 01 04:17:41.195460 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 01 04:17:41.195460 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 01 04:17:41.195460 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 01 04:17:41.195460 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 01 04:17:41.195460 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 01 04:17:41.195460 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:41.195460 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:17:41.195460 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:41.195460 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:17:41.195460 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:17:41.195460 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:17:41.195460 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 01 04:17:41.195460 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 01 04:17:41.196593 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 01 04:17:41.196593 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:41.196593 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-09c79345-2015-41f8-b992-7380e1883793 tempest-VolumesNegativeTest-594124078 tempest-VolumesNegativeTest-594124078-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:17:41.196593 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-09c79345-2015-41f8-b992-7380e1883793 tempest-VolumesNegativeTest-594124078 tempest-VolumesNegativeTest-594124078-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011247 Oct 01 04:17:41.196593 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 2/3] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Oct 1 04:17:41 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 01 04:17:41.196593 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:41.196593 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:41.197792 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:41.198547 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:17:41.203617 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2a11f646-b52f-46b0-86a0-926f0ab8a296 tempest-VolumesNegativeTest-594124078 tempest-VolumesNegativeTest-594124078-project] Calling method '.version_select at 0x7fdfbf90e550>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:17:41.605386 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9a57d726-4e42-40ed-8aa4-610a3ad500e2 tempest-VolumesGetTestJSON-505166259 tempest-VolumesGetTestJSON-505166259-project] Action: 'create', calling method: .version_select at 0x7fdfbf863dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1187284414", "metadata": {"Type": "work"}}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:17:42.726334 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-2a11f646-b52f-46b0-86a0-926f0ab8a296 tempest-VolumesNegativeTest-594124078 tempest-VolumesNegativeTest-594124078-project] HTTP exception thrown: Volume tempest-invalid-587382199 could not be found. Oct 01 04:17:42.730541 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2a11f646-b52f-46b0-86a0-926f0ab8a296 tempest-VolumesNegativeTest-594124078 tempest-VolumesNegativeTest-594124078-project] Request method failure captured: Oct 01 04:17:42.730541 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-587382199 HTTP/1.1 Oct 01 04:17:42.730541 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:17:42.730541 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:17:42.730541 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:17:42.730541 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 0 Oct 01 04:17:42.730541 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:17:42.730541 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:17:42.730541 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:17:42.730541 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:17:42.730541 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN79jo6WCLOHfxaXjp8InQWJPt_wxcqOfRUDc7RPrpletjCxlw3YbvDrvILp2YuI2gp9KLexgmO8NBHyDgSmA_-CPtFOpkq55cEFuoHrtZMiWsOAYRciOXNV20Jnq8GrKIz6OgyJgwGDRfwoLDHMcea_Q0vU6oKwqmPyuo2td3NGeKj4 Oct 01 04:17:42.730541 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:17:42.730541 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:17:42.730541 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:17:42.730541 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:17:42.730541 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:17:42.730541 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:17:42.730541 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: 3ebfba30505f48c181cb04960d38aa63 Oct 01 04:17:42.730541 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-VolumesNegativeTest-594124078 Oct 01 04:17:42.730541 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:17:42.730541 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:17:42.731954 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3ebfba30505f48c181cb04960d38aa63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ebfba30505f48c181cb04960d38aa63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ebfba30505f48c181cb04960d38aa63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3ebfba30505f48c181cb04960d38aa63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:17:42.731954 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-VolumesNegativeTest-594124078 Oct 01 04:17:42.731954 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 3ebfba30505f48c181cb04960d38aa63 Oct 01 04:17:42.731954 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-VolumesNegativeTest-594124078 Oct 01 04:17:42.731954 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-VolumesNegativeTest-594124078-project Oct 01 04:17:42.731954 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:17:42.731954 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:17:42.731954 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: d7e1763c88334c29a14bb192bfe32bb2 Oct 01 04:17:42.731954 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-VolumesNegativeTest-594124078-project Oct 01 04:17:42.731954 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: Oct 01 04:17:42.731954 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Volume tempest-invalid-587382199 could not be found. Oct 01 04:17:42.731954 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'id': 'tempest-invalid-587382199'} Oct 01 04:17:42.731954 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:17:42.732858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:17:42.732858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 04:17:42.732858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 04:17:42.732858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 01 04:17:42.732858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 01 04:17:42.732858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 01 04:17:42.732858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 01 04:17:42.732858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 01 04:17:42.732858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 01 04:17:42.732858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 01 04:17:42.732858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 01 04:17:42.732858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 04:17:42.732858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 04:17:42.732858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 04:17:42.732858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 04:17:42.732858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-587382199 could not be found. (HTTP 404) (Request-ID: req-0c229806-0a8b-4571-bbe5-3ea7e2b7b4de) Oct 01 04:17:42.732858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:42.732858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:17:42.732858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:42.734091 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:17:42.734091 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 01 04:17:42.734091 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 01 04:17:42.734091 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 01 04:17:42.734091 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 01 04:17:42.734091 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 01 04:17:42.734091 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 01 04:17:42.734091 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 01 04:17:42.734091 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 01 04:17:42.734091 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 04:17:42.734091 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 04:17:42.734091 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 01 04:17:42.734091 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 01 04:17:42.734091 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 01 04:17:42.734091 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 01 04:17:42.734091 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 01 04:17:42.734091 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 01 04:17:42.734091 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 01 04:17:42.734091 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 01 04:17:42.735400 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 04:17:42.735400 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 04:17:42.735400 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 04:17:42.735400 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 04:17:42.735400 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-587382199 could not be found. Oct 01 04:17:42.735400 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:42.735400 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:17:42.735400 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:42.735400 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:17:42.735400 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:17:42.735400 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:17:42.735400 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:17:42.735400 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:17:42.735400 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 04:17:42.735400 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 04:17:42.735400 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:17:42.735400 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:17:42.735400 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 01 04:17:42.735400 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:17:42.735400 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-587382199 could not be found. Oct 01 04:17:42.736648 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:42.736648 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:17:42.736648 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:42.736648 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:17:42.736648 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:17:42.736648 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:17:42.736648 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:17:42.736648 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:17:42.736648 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-587382199 could not be found. Oct 01 04:17:42.736648 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:42.736648 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2a11f646-b52f-46b0-86a0-926f0ab8a296 tempest-VolumesNegativeTest-594124078 tempest-VolumesNegativeTest-594124078-project] Returning 404 to user: Volume tempest-invalid-587382199 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:17:42.736648 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2a11f646-b52f-46b0-86a0-926f0ab8a296 tempest-VolumesNegativeTest-594124078 tempest-VolumesNegativeTest-594124078-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-587382199" status: 404 len: 98 microversion: 2.1 time: 1.537432 Oct 01 04:17:42.736648 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 3/4] 10.222.0.26 () {58 vars in 1215 bytes} [Sat Oct 1 04:17:41 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-587382199 => generated 98 bytes in 1539 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 01 04:17:42.742909 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f33bc312-b16e-4c26-960c-5d3cdf0593ed tempest-VolumesNegativeTest-594124078 tempest-VolumesNegativeTest-594124078-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004001 Oct 01 04:17:42.748493 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 4/5] 10.222.0.26 () {58 vars in 1140 bytes} [Sat Oct 1 04:17:42 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 01 04:17:42.766959 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6bb72697-9326-471c-bb91-2e79ffb73b91 tempest-VolumesNegativeTest-594124078 tempest-VolumesNegativeTest-594124078-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.017207 Oct 01 04:17:42.772406 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 5/6] 10.222.0.26 () {58 vars in 1137 bytes} [Sat Oct 1 04:17:42 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 01 04:17:42.784843 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f5d810ab-6bfe-4821-99c7-1c0530efd707 tempest-VolumesNegativeTest-594124078 tempest-VolumesNegativeTest-594124078-project] Calling method '.version_select at 0x7fdfbf696e50>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:17:43.199367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-f5d810ab-6bfe-4821-99c7-1c0530efd707 tempest-VolumesNegativeTest-594124078 tempest-VolumesNegativeTest-594124078-project] HTTP exception thrown: Volume f54e68dd-52ff-4675-85d8-bdb07a81c235 could not be found. Oct 01 04:17:43.202276 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f5d810ab-6bfe-4821-99c7-1c0530efd707 tempest-VolumesNegativeTest-594124078 tempest-VolumesNegativeTest-594124078-project] Request method failure captured: Oct 01 04:17:43.202276 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: DELETE /compute/v2.1/os-volumes/f54e68dd-52ff-4675-85d8-bdb07a81c235 HTTP/1.1 Oct 01 04:17:43.202276 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:17:43.202276 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:17:43.202276 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:17:43.202276 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 0 Oct 01 04:17:43.202276 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:17:43.202276 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:17:43.202276 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:17:43.202276 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:17:43.202276 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN79jo6WCLOHfxaXjp8InQWJPt_wxcqOfRUDc7RPrpletjCxlw3YbvDrvILp2YuI2gp9KLexgmO8NBHyDgSmA_-CPtFOpkq55cEFuoHrtZMiWsOAYRciOXNV20Jnq8GrKIz6OgyJgwGDRfwoLDHMcea_Q0vU6oKwqmPyuo2td3NGeKj4 Oct 01 04:17:43.202276 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:17:43.202276 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:17:43.202276 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:17:43.202276 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:17:43.202276 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:17:43.202276 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:17:43.202276 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: 3ebfba30505f48c181cb04960d38aa63 Oct 01 04:17:43.202276 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-VolumesNegativeTest-594124078 Oct 01 04:17:43.202276 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:17:43.202276 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:17:43.203668 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3ebfba30505f48c181cb04960d38aa63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ebfba30505f48c181cb04960d38aa63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ebfba30505f48c181cb04960d38aa63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3ebfba30505f48c181cb04960d38aa63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:17:43.203668 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-VolumesNegativeTest-594124078 Oct 01 04:17:43.203668 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 3ebfba30505f48c181cb04960d38aa63 Oct 01 04:17:43.203668 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-VolumesNegativeTest-594124078 Oct 01 04:17:43.203668 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-VolumesNegativeTest-594124078-project Oct 01 04:17:43.203668 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:17:43.203668 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:17:43.203668 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: d7e1763c88334c29a14bb192bfe32bb2 Oct 01 04:17:43.203668 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-VolumesNegativeTest-594124078-project Oct 01 04:17:43.203668 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: Oct 01 04:17:43.203668 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Volume f54e68dd-52ff-4675-85d8-bdb07a81c235 could not be found. Oct 01 04:17:43.203668 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'id': 'f54e68dd-52ff-4675-85d8-bdb07a81c235'} Oct 01 04:17:43.203668 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:17:43.205060 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:17:43.205060 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 04:17:43.205060 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 04:17:43.205060 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 01 04:17:43.205060 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 01 04:17:43.205060 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 01 04:17:43.205060 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 01 04:17:43.205060 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 01 04:17:43.205060 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 01 04:17:43.205060 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 01 04:17:43.205060 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 01 04:17:43.205060 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 04:17:43.205060 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 04:17:43.205060 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 04:17:43.205060 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 04:17:43.205060 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f54e68dd-52ff-4675-85d8-bdb07a81c235 could not be found. (HTTP 404) (Request-ID: req-2ec8e620-eae7-45bf-a19b-060d3138a722) Oct 01 04:17:43.205060 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:43.205060 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:17:43.205060 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:43.206164 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:17:43.206164 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 01 04:17:43.206164 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 01 04:17:43.206164 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 01 04:17:43.206164 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 01 04:17:43.206164 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 01 04:17:43.206164 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 01 04:17:43.206164 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 01 04:17:43.206164 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 01 04:17:43.206164 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 04:17:43.206164 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 04:17:43.206164 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 01 04:17:43.206164 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 01 04:17:43.206164 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 01 04:17:43.206164 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 01 04:17:43.206164 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 01 04:17:43.206164 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 01 04:17:43.206164 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 01 04:17:43.206164 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 01 04:17:43.209143 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 04:17:43.209143 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 04:17:43.209143 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 04:17:43.209143 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 04:17:43.209143 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f54e68dd-52ff-4675-85d8-bdb07a81c235 could not be found. Oct 01 04:17:43.209143 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:43.209143 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:17:43.209143 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:43.209143 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:17:43.209143 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:17:43.209143 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:17:43.209143 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:17:43.209143 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:17:43.209143 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 04:17:43.209143 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 04:17:43.209143 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:17:43.209143 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:17:43.209143 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 01 04:17:43.209143 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:17:43.212014 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f54e68dd-52ff-4675-85d8-bdb07a81c235 could not be found. Oct 01 04:17:43.212014 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:43.212014 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:17:43.212014 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:43.212014 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:17:43.212014 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:17:43.212014 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:17:43.212014 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:17:43.212014 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:17:43.212014 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f54e68dd-52ff-4675-85d8-bdb07a81c235 could not be found. Oct 01 04:17:43.212014 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:43.215956 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f5d810ab-6bfe-4821-99c7-1c0530efd707 tempest-VolumesNegativeTest-594124078 tempest-VolumesNegativeTest-594124078-project] Returning 404 to user: Volume f54e68dd-52ff-4675-85d8-bdb07a81c235 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:17:43.215956 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f5d810ab-6bfe-4821-99c7-1c0530efd707 tempest-VolumesNegativeTest-594124078 tempest-VolumesNegativeTest-594124078-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/f54e68dd-52ff-4675-85d8-bdb07a81c235" status: 404 len: 109 microversion: 2.1 time: 0.435902 Oct 01 04:17:43.216504 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 6/7] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 1 04:17:42 2022] DELETE /compute/v2.1/os-volumes/f54e68dd-52ff-4675-85d8-bdb07a81c235 => generated 109 bytes in 438 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:17:43.225491 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-89bbeb17-5808-4c11-930f-ef8c1815c9c9 tempest-VolumesNegativeTest-594124078 tempest-VolumesNegativeTest-594124078-project] Calling method '.version_select at 0x7fdfbf6c6670>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:17:43.425334 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-89bbeb17-5808-4c11-930f-ef8c1815c9c9 tempest-VolumesNegativeTest-594124078 tempest-VolumesNegativeTest-594124078-project] HTTP exception thrown: Volume 9de8a08a-a95f-4eab-b6f3-95cefec05340 could not be found. Oct 01 04:17:43.429464 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-89bbeb17-5808-4c11-930f-ef8c1815c9c9 tempest-VolumesNegativeTest-594124078 tempest-VolumesNegativeTest-594124078-project] Request method failure captured: Oct 01 04:17:43.429464 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/os-volumes/9de8a08a-a95f-4eab-b6f3-95cefec05340 HTTP/1.1 Oct 01 04:17:43.429464 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:17:43.429464 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:17:43.429464 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:17:43.429464 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 0 Oct 01 04:17:43.429464 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:17:43.429464 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:17:43.429464 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:17:43.429464 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:17:43.429464 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN79jo6WCLOHfxaXjp8InQWJPt_wxcqOfRUDc7RPrpletjCxlw3YbvDrvILp2YuI2gp9KLexgmO8NBHyDgSmA_-CPtFOpkq55cEFuoHrtZMiWsOAYRciOXNV20Jnq8GrKIz6OgyJgwGDRfwoLDHMcea_Q0vU6oKwqmPyuo2td3NGeKj4 Oct 01 04:17:43.429464 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:17:43.429464 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:17:43.429464 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:17:43.429464 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:17:43.429464 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:17:43.429464 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:17:43.429464 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: 3ebfba30505f48c181cb04960d38aa63 Oct 01 04:17:43.429464 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-VolumesNegativeTest-594124078 Oct 01 04:17:43.429464 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:17:43.429464 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:17:43.430939 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3ebfba30505f48c181cb04960d38aa63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ebfba30505f48c181cb04960d38aa63"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3ebfba30505f48c181cb04960d38aa63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3ebfba30505f48c181cb04960d38aa63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:17:43.430939 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-VolumesNegativeTest-594124078 Oct 01 04:17:43.430939 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 3ebfba30505f48c181cb04960d38aa63 Oct 01 04:17:43.430939 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-VolumesNegativeTest-594124078 Oct 01 04:17:43.430939 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-VolumesNegativeTest-594124078-project Oct 01 04:17:43.430939 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:17:43.430939 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:17:43.430939 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: d7e1763c88334c29a14bb192bfe32bb2 Oct 01 04:17:43.430939 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-VolumesNegativeTest-594124078-project Oct 01 04:17:43.430939 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: Oct 01 04:17:43.430939 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Volume 9de8a08a-a95f-4eab-b6f3-95cefec05340 could not be found. Oct 01 04:17:43.430939 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'id': '9de8a08a-a95f-4eab-b6f3-95cefec05340'} Oct 01 04:17:43.430939 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:17:43.431874 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:17:43.431874 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 04:17:43.431874 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 04:17:43.431874 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 01 04:17:43.431874 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 01 04:17:43.431874 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 01 04:17:43.431874 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 01 04:17:43.431874 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 01 04:17:43.431874 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 01 04:17:43.431874 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 01 04:17:43.431874 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 01 04:17:43.431874 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 04:17:43.431874 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 04:17:43.431874 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 04:17:43.431874 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 04:17:43.431874 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9de8a08a-a95f-4eab-b6f3-95cefec05340 could not be found. (HTTP 404) (Request-ID: req-be777127-a515-4610-b7f7-f47dbf6459ac) Oct 01 04:17:43.431874 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:43.431874 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:17:43.431874 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:43.433310 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:17:43.433310 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 01 04:17:43.433310 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 01 04:17:43.433310 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 01 04:17:43.433310 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 01 04:17:43.433310 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 01 04:17:43.433310 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 01 04:17:43.433310 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 01 04:17:43.433310 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 01 04:17:43.433310 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 04:17:43.433310 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 04:17:43.433310 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 01 04:17:43.433310 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 01 04:17:43.433310 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 01 04:17:43.433310 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 01 04:17:43.433310 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 01 04:17:43.433310 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 01 04:17:43.433310 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 01 04:17:43.433310 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 01 04:17:43.435011 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 04:17:43.435011 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 04:17:43.435011 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 04:17:43.435011 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 04:17:43.435011 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9de8a08a-a95f-4eab-b6f3-95cefec05340 could not be found. Oct 01 04:17:43.435011 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:43.435011 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:17:43.435011 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:43.435011 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:17:43.435011 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:17:43.435011 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:17:43.435011 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:17:43.435011 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:17:43.435011 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 04:17:43.435011 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 04:17:43.435011 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:17:43.435011 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:17:43.435011 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 01 04:17:43.435011 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:17:43.437367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9de8a08a-a95f-4eab-b6f3-95cefec05340 could not be found. Oct 01 04:17:43.437367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:43.437367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:17:43.437367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:43.437367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:17:43.437367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:17:43.437367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:17:43.437367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:17:43.437367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:17:43.437367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9de8a08a-a95f-4eab-b6f3-95cefec05340 could not be found. Oct 01 04:17:43.437367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:17:43.441797 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-89bbeb17-5808-4c11-930f-ef8c1815c9c9 tempest-VolumesNegativeTest-594124078 tempest-VolumesNegativeTest-594124078-project] Returning 404 to user: Volume 9de8a08a-a95f-4eab-b6f3-95cefec05340 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:17:43.442691 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-89bbeb17-5808-4c11-930f-ef8c1815c9c9 tempest-VolumesNegativeTest-594124078 tempest-VolumesNegativeTest-594124078-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/9de8a08a-a95f-4eab-b6f3-95cefec05340" status: 404 len: 109 microversion: 2.1 time: 0.221282 Oct 01 04:17:43.443679 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 7/8] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 1 04:17:43 2022] GET /compute/v2.1/os-volumes/9de8a08a-a95f-4eab-b6f3-95cefec05340 => generated 109 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:17:43.586282 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9a57d726-4e42-40ed-8aa4-610a3ad500e2 tempest-VolumesGetTestJSON-505166259 tempest-VolumesGetTestJSON-505166259-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.440027 Oct 01 04:17:43.586922 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 2/9] 10.222.0.26 () {60 vars in 1156 bytes} [Sat Oct 1 04:17:41 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2443 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 01 04:17:43.603975 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c3989e99-3408-4238-af07-b095ab17e3fe tempest-VolumesGetTestJSON-505166259 tempest-VolumesGetTestJSON-505166259-project] Calling method '.version_select at 0x7fdfbf696d30>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:17:43.779335 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c3989e99-3408-4238-af07-b095ab17e3fe tempest-VolumesGetTestJSON-505166259 tempest-VolumesGetTestJSON-505166259-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/9b370a18-5695-4a62-b71f-99e912b11570" status: 200 len: 353 microversion: 2.1 time: 0.180902 Oct 01 04:17:43.787022 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 8/10] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 1 04:17:43 2022] GET /compute/v2.1/os-volumes/9b370a18-5695-4a62-b71f-99e912b11570 => generated 353 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:17:44.795770 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-332e9164-102b-42b0-bfc0-d51e1cfc8736 tempest-VolumesGetTestJSON-505166259 tempest-VolumesGetTestJSON-505166259-project] Calling method '.version_select at 0x7fdfbf6f2940>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:17:44.969268 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-332e9164-102b-42b0-bfc0-d51e1cfc8736 tempest-VolumesGetTestJSON-505166259 tempest-VolumesGetTestJSON-505166259-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/9b370a18-5695-4a62-b71f-99e912b11570" status: 200 len: 354 microversion: 2.1 time: 0.178389 Oct 01 04:17:44.978137 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 3/11] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 1 04:17:44 2022] GET /compute/v2.1/os-volumes/9b370a18-5695-4a62-b71f-99e912b11570 => generated 354 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:17:44.984655 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-144a8ca6-9455-4d56-a158-25da5b227f86 tempest-VolumesGetTestJSON-505166259 tempest-VolumesGetTestJSON-505166259-project] Calling method '.version_select at 0x7fdfbf6c6550>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:17:45.071750 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-144a8ca6-9455-4d56-a158-25da5b227f86 tempest-VolumesGetTestJSON-505166259 tempest-VolumesGetTestJSON-505166259-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/9b370a18-5695-4a62-b71f-99e912b11570" status: 200 len: 354 microversion: 2.1 time: 0.092193 Oct 01 04:17:45.072716 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 9/12] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 1 04:17:44 2022] GET /compute/v2.1/os-volumes/9b370a18-5695-4a62-b71f-99e912b11570 => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:17:45.090814 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-85d4eee6-1f3c-4dc0-a541-200dc74f0f59 tempest-VolumesGetTestJSON-505166259 tempest-VolumesGetTestJSON-505166259-project] Calling method '.version_select at 0x7fdfbf702040>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:17:45.291306 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-85d4eee6-1f3c-4dc0-a541-200dc74f0f59 tempest-VolumesGetTestJSON-505166259 tempest-VolumesGetTestJSON-505166259-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/9b370a18-5695-4a62-b71f-99e912b11570" status: 202 len: 0 microversion: 2.1 time: 0.204319 Oct 01 04:17:45.292569 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 4/13] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 1 04:17:45 2022] DELETE /compute/v2.1/os-volumes/9b370a18-5695-4a62-b71f-99e912b11570 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 04:17:45.302218 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3600ee2e-fc09-4a80-b09f-4879ba8dc064 tempest-VolumesGetTestJSON-505166259 tempest-VolumesGetTestJSON-505166259-project] Calling method '.version_select at 0x7fdfbf6c6e50>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:17:45.381211 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3600ee2e-fc09-4a80-b09f-4879ba8dc064 tempest-VolumesGetTestJSON-505166259 tempest-VolumesGetTestJSON-505166259-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/9b370a18-5695-4a62-b71f-99e912b11570" status: 200 len: 353 microversion: 2.1 time: 0.084455 Oct 01 04:17:45.382066 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 10/14] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 1 04:17:45 2022] GET /compute/v2.1/os-volumes/9b370a18-5695-4a62-b71f-99e912b11570 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:17:46.423772 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-205c46c6-2f2c-4c97-99d4-06a42985e43b tempest-VolumesGetTestJSON-505166259 tempest-VolumesGetTestJSON-505166259-project] Calling method '.version_select at 0x7fdfbf6f2e50>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:17:46.519021 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-205c46c6-2f2c-4c97-99d4-06a42985e43b tempest-VolumesGetTestJSON-505166259 tempest-VolumesGetTestJSON-505166259-project] HTTP exception thrown: Volume 9b370a18-5695-4a62-b71f-99e912b11570 could not be found. Oct 01 04:17:46.525035 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-205c46c6-2f2c-4c97-99d4-06a42985e43b tempest-VolumesGetTestJSON-505166259 tempest-VolumesGetTestJSON-505166259-project] Request method failure captured: Oct 01 04:17:46.525035 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: request: GET /compute/v2.1/os-volumes/9b370a18-5695-4a62-b71f-99e912b11570 HTTP/1.1 Oct 01 04:17:46.525035 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept: application/json Oct 01 04:17:46.525035 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept-Encoding: identity Oct 01 04:17:46.525035 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Connection: close Oct 01 04:17:46.525035 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Length: 0 Oct 01 04:17:46.525035 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Type: application/json Oct 01 04:17:46.525035 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Host: 10.222.0.26 Oct 01 04:17:46.525035 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 01 04:17:46.525035 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 01 04:17:46.525035 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjN79lBNCfUSZqSQ4z0ftfueR2TiLUWUOQ3e1p6laN20lhsmDdUfxWLWGIYNoLPc5MFPjAXMo_myHgPVwH2JDmzngkG-uQV9KtRpOaE5z3d2dX3dOZRzUTJuOui651lL079zLZ7Dj00KGEaJBiT14d540AU_P4Of5R9dwiJooyAv-gWN8 Oct 01 04:17:46.525035 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Id: None Oct 01 04:17:46.525035 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Name: None Oct 01 04:17:46.525035 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 01 04:17:46.525035 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 01 04:17:46.525035 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 01 04:17:46.525035 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 01 04:17:46.525035 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Id: d741cb6333b846708b3d55abd77b3934 Oct 01 04:17:46.525035 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Name: tempest-VolumesGetTestJSON-505166259 Oct 01 04:17:46.525035 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Role: reader,member Oct 01 04:17:46.525035 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Roles: reader,member Oct 01 04:17:46.526231 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d741cb6333b846708b3d55abd77b3934"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d741cb6333b846708b3d55abd77b3934"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d741cb6333b846708b3d55abd77b3934"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d741cb6333b846708b3d55abd77b3934"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:17:46.526231 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant: tempest-VolumesGetTestJSON-505166259 Oct 01 04:17:46.526231 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Id: d741cb6333b846708b3d55abd77b3934 Oct 01 04:17:46.526231 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Name: tempest-VolumesGetTestJSON-505166259 Oct 01 04:17:46.526231 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User: tempest-VolumesGetTestJSON-505166259-project Oct 01 04:17:46.526231 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 01 04:17:46.526231 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 01 04:17:46.526231 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Id: bbe1637bd0df445b87f04561ccbbaafe Oct 01 04:17:46.526231 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Name: tempest-VolumesGetTestJSON-505166259-project Oct 01 04:17:46.526231 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: method: Oct 01 04:17:46.526231 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: exception: Volume 9b370a18-5695-4a62-b71f-99e912b11570 could not be found. Oct 01 04:17:46.526231 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: action_args: {'id': '9b370a18-5695-4a62-b71f-99e912b11570'} Oct 01 04:17:46.526231 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:17:46.527162 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:17:46.527162 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 04:17:46.527162 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 04:17:46.527162 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 01 04:17:46.527162 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 01 04:17:46.527162 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 01 04:17:46.527162 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 01 04:17:46.527162 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 01 04:17:46.527162 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 01 04:17:46.527162 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 01 04:17:46.527162 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 01 04:17:46.527162 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 04:17:46.527162 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 04:17:46.527162 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 04:17:46.527162 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 04:17:46.527162 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9b370a18-5695-4a62-b71f-99e912b11570 could not be found. (HTTP 404) (Request-ID: req-84e690b9-f791-46c8-964a-2d1434c3507b) Oct 01 04:17:46.527162 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:17:46.527162 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:17:46.527162 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:17:46.528837 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:17:46.528837 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 01 04:17:46.528837 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 01 04:17:46.528837 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 01 04:17:46.528837 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 01 04:17:46.528837 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 01 04:17:46.528837 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 01 04:17:46.528837 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 01 04:17:46.528837 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 01 04:17:46.528837 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 04:17:46.528837 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 04:17:46.528837 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 01 04:17:46.528837 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 01 04:17:46.528837 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 01 04:17:46.528837 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 01 04:17:46.528837 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 01 04:17:46.528837 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 01 04:17:46.528837 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 01 04:17:46.528837 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 01 04:17:46.529754 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 04:17:46.529754 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 04:17:46.529754 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 04:17:46.529754 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 04:17:46.529754 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9b370a18-5695-4a62-b71f-99e912b11570 could not be found. Oct 01 04:17:46.529754 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:17:46.529754 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:17:46.529754 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:17:46.529754 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:17:46.529754 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:17:46.529754 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:17:46.529754 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:17:46.529754 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:17:46.529754 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 04:17:46.529754 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 04:17:46.529754 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:17:46.529754 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:17:46.529754 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 01 04:17:46.529754 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:17:46.531654 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9b370a18-5695-4a62-b71f-99e912b11570 could not be found. Oct 01 04:17:46.531654 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:17:46.531654 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:17:46.531654 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:17:46.531654 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:17:46.531654 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:17:46.531654 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:17:46.531654 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:17:46.531654 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:17:46.531654 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9b370a18-5695-4a62-b71f-99e912b11570 could not be found. Oct 01 04:17:46.531654 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:17:46.531654 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-205c46c6-2f2c-4c97-99d4-06a42985e43b tempest-VolumesGetTestJSON-505166259 tempest-VolumesGetTestJSON-505166259-project] Returning 404 to user: Volume 9b370a18-5695-4a62-b71f-99e912b11570 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:17:46.531654 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-205c46c6-2f2c-4c97-99d4-06a42985e43b tempest-VolumesGetTestJSON-505166259 tempest-VolumesGetTestJSON-505166259-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/9b370a18-5695-4a62-b71f-99e912b11570" status: 404 len: 109 microversion: 2.1 time: 0.133052 Oct 01 04:17:46.531654 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 5/15] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 1 04:17:46 2022] GET /compute/v2.1/os-volumes/9b370a18-5695-4a62-b71f-99e912b11570 => generated 109 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:17:56.173579 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-97221238-1b45-426d-8dd7-00c610c7bb53 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1539081779", "imageRef": "c63d52d7-4e3d-40cf-a8b5-59a2d027d793", "flavorRef": "452", "networks": [{"uuid": "8dd89a22-dfc1-4ff5-8687-6381c17de176"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:17:56.429046 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-97221238-1b45-426d-8dd7-00c610c7bb53 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] validate_networks() for [('8dd89a22-dfc1-4ff5-8687-6381c17de176', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 04:17:59.185842 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-97221238-1b45-426d-8dd7-00c610c7bb53 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 04:17:59.187022 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-97221238-1b45-426d-8dd7-00c610c7bb53 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 04:17:59.187668 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-97221238-1b45-426d-8dd7-00c610c7bb53 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 04:17:59.188806 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-97221238-1b45-426d-8dd7-00c610c7bb53 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 04:17:59.189836 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-97221238-1b45-426d-8dd7-00c610c7bb53 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 04:17:59.259261 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97221238-1b45-426d-8dd7-00c610c7bb53 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:17:59.259783 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97221238-1b45-426d-8dd7-00c610c7bb53 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:17:59.263140 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97221238-1b45-426d-8dd7-00c610c7bb53 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:17:59.272873 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97221238-1b45-426d-8dd7-00c610c7bb53 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:17:59.273605 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97221238-1b45-426d-8dd7-00c610c7bb53 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:17:59.274064 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97221238-1b45-426d-8dd7-00c610c7bb53 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:17:59.426246 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-97221238-1b45-426d-8dd7-00c610c7bb53 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Getting quotas for project c1b321c355e94b8496955f09f547f561. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:17:59.469572 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-97221238-1b45-426d-8dd7-00c610c7bb53 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Getting quotas for user bfcc0e7f557e4334a808f5dfaffe93db and project c1b321c355e94b8496955f09f547f561. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:17:59.525061 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-97221238-1b45-426d-8dd7-00c610c7bb53 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 04:17:59.536317 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-97221238-1b45-426d-8dd7-00c610c7bb53 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c63d52d7-4e3d-40cf-a8b5-59a2d027d793',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 04:17:59.723898 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-97221238-1b45-426d-8dd7-00c610c7bb53 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.842645 Oct 01 04:17:59.731488 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 11/16] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 1 04:17:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 04:17:59.755452 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ae563495-833a-4a37-8dbf-5607fd2f5476 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:17:59.757587 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ae563495-833a-4a37-8dbf-5607fd2f5476 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:00.121881 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c2772755-9c4a-464e-a4b5-5904c407aefd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Action: 'create', calling method: .version_select at 0x7fdfbf8673a0>, body: {"keypair": {"name": "tempest-keypair-2118104381", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqy/AR7r9DDhj4rEkvmcjGI0y8ecRcPfzwuH0px3EXy9GTCwJm/IWG5XTxaLJuqTaxDQIdGZdOvor0FzH3avBZowEG/eVmJakrDxc9FzhuO4jkvDiU4ny9WFQ7CQI3DXQ=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:18:00.330394 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-c2772755-9c4a-464e-a4b5-5904c407aefd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Getting quotas for project 16cd7bcb315d4dc58f73a9918adb57e2. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:18:00.343295 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-c2772755-9c4a-464e-a4b5-5904c407aefd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Getting quotas for user 3caf1cc366434d418c474d7a1879faa7 and project 16cd7bcb315d4dc58f73a9918adb57e2. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:18:00.354960 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ae563495-833a-4a37-8dbf-5607fd2f5476 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:00.407841 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ae563495-833a-4a37-8dbf-5607fd2f5476 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1215 microversion: 2.1 time: 0.665762 Oct 01 04:18:00.409306 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 12/17] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:17:59 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1215 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:00.494366 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c2772755-9c4a-464e-a4b5-5904c407aefd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.141422 Oct 01 04:18:00.496290 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 6/18] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 1 04:17:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:18:01.436033 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-32d0cf5d-e280-4d41-81a6-4435f9962e71 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:01.436661 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-32d0cf5d-e280-4d41-81a6-4435f9962e71 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:02.024063 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-837d20ae-ffe9-4495-b9b2-389a5a2b8b2c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Action: 'create', calling method: .version_select at 0x7fdfbf623790>, body: {"keypair": {"name": "tempest-keypair-1577233801", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCvDPB5yVlZU6dn2PygRYMsNjEblvjo8bMD4yXQHxEJ0G2m7qX5F9Fl+F9IffOovob7Ry2OAvH/PXfkKE8kpYULFxjk6H60yRR+Z3ohXsimXfh6N0kSG728s00lg+YW2fA=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:18:02.101095 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-837d20ae-ffe9-4495-b9b2-389a5a2b8b2c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Getting quotas for project 19d87f6d9adf4ce98e934187ec8ae0d7. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:18:02.121645 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-837d20ae-ffe9-4495-b9b2-389a5a2b8b2c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Getting quotas for user ccd631925a0a4f5ca8be5d3915778487 and project 19d87f6d9adf4ce98e934187ec8ae0d7. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:18:02.168621 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-32d0cf5d-e280-4d41-81a6-4435f9962e71 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:02.181140 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-32d0cf5d-e280-4d41-81a6-4435f9962e71 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1215 microversion: 2.1 time: 0.747795 Oct 01 04:18:02.185639 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 13/19] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:01 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1215 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:02.226698 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-837d20ae-ffe9-4495-b9b2-389a5a2b8b2c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.554838 Oct 01 04:18:02.228147 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 7/20] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Oct 1 04:18:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 560 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 01 04:18:03.208764 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e68f45cd-82f6-4577-8b43-c5db9cfef8d3 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:03.209952 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e68f45cd-82f6-4577-8b43-c5db9cfef8d3 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:03.218224 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e68f45cd-82f6-4577-8b43-c5db9cfef8d3 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:03.231697 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e68f45cd-82f6-4577-8b43-c5db9cfef8d3 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:03.234769 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e68f45cd-82f6-4577-8b43-c5db9cfef8d3 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:03.237881 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e68f45cd-82f6-4577-8b43-c5db9cfef8d3 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:03.245700 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e68f45cd-82f6-4577-8b43-c5db9cfef8d3 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:03.245905 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e68f45cd-82f6-4577-8b43-c5db9cfef8d3 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:03.714438 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e68f45cd-82f6-4577-8b43-c5db9cfef8d3 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:03.740422 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e68f45cd-82f6-4577-8b43-c5db9cfef8d3 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1267 microversion: 2.1 time: 0.535310 Oct 01 04:18:03.741861 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 14/21] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:03 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1267 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:04.767932 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d65b9273-029b-439c-b499-22a36bf00f00 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:04.769293 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d65b9273-029b-439c-b499-22a36bf00f00 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:04.830423 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d65b9273-029b-439c-b499-22a36bf00f00 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:04.831043 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d65b9273-029b-439c-b499-22a36bf00f00 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:04.831476 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d65b9273-029b-439c-b499-22a36bf00f00 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:04.841317 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d65b9273-029b-439c-b499-22a36bf00f00 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:04.843426 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d65b9273-029b-439c-b499-22a36bf00f00 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:04.846187 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d65b9273-029b-439c-b499-22a36bf00f00 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:05.713107 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-d65b9273-029b-439c-b499-22a36bf00f00 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:05.769973 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d65b9273-029b-439c-b499-22a36bf00f00 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1273 microversion: 2.1 time: 1.006232 Oct 01 04:18:05.789681 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 8/22] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:04 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1273 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:06.444372 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-449784dd-ba0c-4f00-af32-343b5c9fc3bd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1364520959", "imageRef": "c63d52d7-4e3d-40cf-a8b5-59a2d027d793", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:18:06.610165 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-449784dd-ba0c-4f00-af32-343b5c9fc3bd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] validate_networks() for [('9e21d865-d526-49ca-8e76-21cf583604c4', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 04:18:06.801609 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3786c388-e9e9-471a-be79-28bc85c491ea tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:06.802233 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3786c388-e9e9-471a-be79-28bc85c491ea tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:06.816274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3786c388-e9e9-471a-be79-28bc85c491ea tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:06.816742 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3786c388-e9e9-471a-be79-28bc85c491ea tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:06.817216 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3786c388-e9e9-471a-be79-28bc85c491ea tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:06.817931 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3786c388-e9e9-471a-be79-28bc85c491ea tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:06.818390 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3786c388-e9e9-471a-be79-28bc85c491ea tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:06.818817 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3786c388-e9e9-471a-be79-28bc85c491ea tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:07.329230 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-3786c388-e9e9-471a-be79-28bc85c491ea tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:07.339996 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3786c388-e9e9-471a-be79-28bc85c491ea tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1273 microversion: 2.1 time: 0.542640 Oct 01 04:18:07.371276 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 9/23] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:06 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1273 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:07.397360 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9bae5538-7dea-4edc-96e0-34f2a5ec2155 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-868595509", "imageRef": "c63d52d7-4e3d-40cf-a8b5-59a2d027d793", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3af0afc2-a8fa-427e-a8af-57c40105fd2b"}], "security_groups": [{"name": "tempest-securitygroup--1372705526"}], "key_name": "tempest-keypair-2118104381", "user_data": "}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:18:08.091234 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-9bae5538-7dea-4edc-96e0-34f2a5ec2155 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] validate_networks() for [('3af0afc2-a8fa-427e-a8af-57c40105fd2b', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 04:18:09.337574 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:09.756284 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-449784dd-ba0c-4f00-af32-343b5c9fc3bd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 04:18:09.760270 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-449784dd-ba0c-4f00-af32-343b5c9fc3bd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 04:18:09.762364 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-449784dd-ba0c-4f00-af32-343b5c9fc3bd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 04:18:09.763951 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-449784dd-ba0c-4f00-af32-343b5c9fc3bd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 04:18:09.765549 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-449784dd-ba0c-4f00-af32-343b5c9fc3bd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 04:18:09.784844 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-449784dd-ba0c-4f00-af32-343b5c9fc3bd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:09.786017 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-449784dd-ba0c-4f00-af32-343b5c9fc3bd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:09.786915 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-449784dd-ba0c-4f00-af32-343b5c9fc3bd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:09.788063 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-449784dd-ba0c-4f00-af32-343b5c9fc3bd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:09.788881 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-449784dd-ba0c-4f00-af32-343b5c9fc3bd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:09.789809 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-449784dd-ba0c-4f00-af32-343b5c9fc3bd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:09.816427 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-449784dd-ba0c-4f00-af32-343b5c9fc3bd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Getting quotas for project 839c91c5262a49768c3e937b5a034137. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:18:09.821887 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-449784dd-ba0c-4f00-af32-343b5c9fc3bd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Getting quotas for user 7014a1defd81461787318bc27d56b9aa and project 839c91c5262a49768c3e937b5a034137. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:18:09.837437 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-449784dd-ba0c-4f00-af32-343b5c9fc3bd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 04:18:09.840646 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-449784dd-ba0c-4f00-af32-343b5c9fc3bd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c63d52d7-4e3d-40cf-a8b5-59a2d027d793',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 04:18:09.915965 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-449784dd-ba0c-4f00-af32-343b5c9fc3bd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.714652 Oct 01 04:18:09.918161 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 15/24] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 1 04:18:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 4718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 04:18:09.923422 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b953db1c-5b96-4814-953c-f94d0421e1d0 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:09.925126 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b953db1c-5b96-4814-953c-f94d0421e1d0 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:09.933050 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b953db1c-5b96-4814-953c-f94d0421e1d0 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:09.934065 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b953db1c-5b96-4814-953c-f94d0421e1d0 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:09.934975 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b953db1c-5b96-4814-953c-f94d0421e1d0 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:09.936122 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b953db1c-5b96-4814-953c-f94d0421e1d0 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:09.936886 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b953db1c-5b96-4814-953c-f94d0421e1d0 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:09.938176 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b953db1c-5b96-4814-953c-f94d0421e1d0 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:10.764538 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b953db1c-5b96-4814-953c-f94d0421e1d0 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:10.784646 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b953db1c-5b96-4814-953c-f94d0421e1d0 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1315 microversion: 2.1 time: 0.863297 Oct 01 04:18:10.787107 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 16/25] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:09 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1315 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:10.798587 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dcd79da1-e066-4164-ba67-2d2f51778f70 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:10.800863 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dcd79da1-e066-4164-ba67-2d2f51778f70 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:10.928775 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-dcd79da1-e066-4164-ba67-2d2f51778f70 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:10.941567 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dcd79da1-e066-4164-ba67-2d2f51778f70 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a" status: 200 len: 1222 microversion: 2.1 time: 0.150728 Oct 01 04:18:10.945357 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 17/26] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:10 2022] GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a => generated 1222 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:10.962191 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2d7535ef-37e4-4e30-a7bb-d571216a8786 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1178727862", "imageRef": "c63d52d7-4e3d-40cf-a8b5-59a2d027d793", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41ad6d82-393d-469b-ad56-b82ab9a77fee"}], "security_groups": [{"name": "tempest-securitygroup--1316571595"}], "key_name": "tempest-keypair-1577233801", "user_data": "}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:18:11.509523 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-2d7535ef-37e4-4e30-a7bb-d571216a8786 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] validate_networks() for [('41ad6d82-393d-469b-ad56-b82ab9a77fee', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 04:18:12.173618 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=8 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:12.589756 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-9bae5538-7dea-4edc-96e0-34f2a5ec2155 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 04:18:12.590551 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-9bae5538-7dea-4edc-96e0-34f2a5ec2155 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 04:18:12.594666 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-9bae5538-7dea-4edc-96e0-34f2a5ec2155 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 04:18:12.595091 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-9bae5538-7dea-4edc-96e0-34f2a5ec2155 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 04:18:12.595990 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-9bae5538-7dea-4edc-96e0-34f2a5ec2155 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 04:18:12.626459 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9bae5538-7dea-4edc-96e0-34f2a5ec2155 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:12.626973 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9bae5538-7dea-4edc-96e0-34f2a5ec2155 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:12.627413 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9bae5538-7dea-4edc-96e0-34f2a5ec2155 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:12.655652 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9bae5538-7dea-4edc-96e0-34f2a5ec2155 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:12.656987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9bae5538-7dea-4edc-96e0-34f2a5ec2155 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:12.657508 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9bae5538-7dea-4edc-96e0-34f2a5ec2155 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:12.742414 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-9bae5538-7dea-4edc-96e0-34f2a5ec2155 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Getting quotas for project 16cd7bcb315d4dc58f73a9918adb57e2. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:18:12.758156 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-9bae5538-7dea-4edc-96e0-34f2a5ec2155 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Getting quotas for user 3caf1cc366434d418c474d7a1879faa7 and project 16cd7bcb315d4dc58f73a9918adb57e2. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:18:12.789131 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9bae5538-7dea-4edc-96e0-34f2a5ec2155 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 04:18:12.799400 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9bae5538-7dea-4edc-96e0-34f2a5ec2155 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c63d52d7-4e3d-40cf-a8b5-59a2d027d793',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 04:18:12.972596 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9bae5538-7dea-4edc-96e0-34f2a5ec2155 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.600031 Oct 01 04:18:12.975080 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 10/27] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 1 04:18:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 5602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 04:18:12.983374 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3a4acc49-d90c-4ab6-9df0-2aec6476412d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1580167593", "imageRef": "c63d52d7-4e3d-40cf-a8b5-59a2d027d793", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:18:13.070473 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-3a4acc49-d90c-4ab6-9df0-2aec6476412d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] validate_networks() for [('9e21d865-d526-49ca-8e76-21cf583604c4', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 04:18:13.766159 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-2d7535ef-37e4-4e30-a7bb-d571216a8786 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 04:18:13.766748 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-2d7535ef-37e4-4e30-a7bb-d571216a8786 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 04:18:13.767283 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-2d7535ef-37e4-4e30-a7bb-d571216a8786 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 04:18:13.767736 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-2d7535ef-37e4-4e30-a7bb-d571216a8786 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 04:18:13.768117 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-2d7535ef-37e4-4e30-a7bb-d571216a8786 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 04:18:13.784280 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d7535ef-37e4-4e30-a7bb-d571216a8786 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:13.791220 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d7535ef-37e4-4e30-a7bb-d571216a8786 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:13.796141 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d7535ef-37e4-4e30-a7bb-d571216a8786 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:13.797049 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d7535ef-37e4-4e30-a7bb-d571216a8786 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:13.805068 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d7535ef-37e4-4e30-a7bb-d571216a8786 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:13.807413 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d7535ef-37e4-4e30-a7bb-d571216a8786 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:13.906199 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-2d7535ef-37e4-4e30-a7bb-d571216a8786 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Getting quotas for project 19d87f6d9adf4ce98e934187ec8ae0d7. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:18:13.930340 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-2d7535ef-37e4-4e30-a7bb-d571216a8786 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Getting quotas for user ccd631925a0a4f5ca8be5d3915778487 and project 19d87f6d9adf4ce98e934187ec8ae0d7. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:18:13.973439 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2d7535ef-37e4-4e30-a7bb-d571216a8786 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 04:18:13.982016 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2d7535ef-37e4-4e30-a7bb-d571216a8786 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c63d52d7-4e3d-40cf-a8b5-59a2d027d793',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 04:18:14.117553 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2d7535ef-37e4-4e30-a7bb-d571216a8786 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.169891 Oct 01 04:18:14.119131 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 18/28] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 1 04:18:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 3173 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 01 04:18:14.131416 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2e426268-d183-4282-abec-bf569b3b2456 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:14.132280 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2e426268-d183-4282-abec-bf569b3b2456 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:14.175939 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e426268-d183-4282-abec-bf569b3b2456 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:14.179889 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e426268-d183-4282-abec-bf569b3b2456 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:14.180668 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e426268-d183-4282-abec-bf569b3b2456 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:14.183214 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e426268-d183-4282-abec-bf569b3b2456 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:14.183214 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e426268-d183-4282-abec-bf569b3b2456 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:14.183829 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e426268-d183-4282-abec-bf569b3b2456 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:14.555674 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-3a4acc49-d90c-4ab6-9df0-2aec6476412d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 04:18:14.556854 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-3a4acc49-d90c-4ab6-9df0-2aec6476412d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 04:18:14.558549 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-3a4acc49-d90c-4ab6-9df0-2aec6476412d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 04:18:14.558971 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-3a4acc49-d90c-4ab6-9df0-2aec6476412d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 04:18:14.559405 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-3a4acc49-d90c-4ab6-9df0-2aec6476412d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 04:18:14.599698 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a4acc49-d90c-4ab6-9df0-2aec6476412d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:14.601454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a4acc49-d90c-4ab6-9df0-2aec6476412d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:14.606426 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a4acc49-d90c-4ab6-9df0-2aec6476412d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:14.608403 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a4acc49-d90c-4ab6-9df0-2aec6476412d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:14.609366 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a4acc49-d90c-4ab6-9df0-2aec6476412d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:14.610122 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a4acc49-d90c-4ab6-9df0-2aec6476412d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:14.653177 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-3a4acc49-d90c-4ab6-9df0-2aec6476412d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Getting quotas for project 839c91c5262a49768c3e937b5a034137. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:18:14.665470 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-3a4acc49-d90c-4ab6-9df0-2aec6476412d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Getting quotas for user 7014a1defd81461787318bc27d56b9aa and project 839c91c5262a49768c3e937b5a034137. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:18:14.704313 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2e426268-d183-4282-abec-bf569b3b2456 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:14.704774 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3a4acc49-d90c-4ab6-9df0-2aec6476412d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 04:18:14.707049 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3a4acc49-d90c-4ab6-9df0-2aec6476412d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c63d52d7-4e3d-40cf-a8b5-59a2d027d793',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 04:18:14.713311 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2e426268-d183-4282-abec-bf569b3b2456 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1315 microversion: 2.1 time: 0.592466 Oct 01 04:18:14.724110 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 19/29] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:14 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1315 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:14.932957 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3a4acc49-d90c-4ab6-9df0-2aec6476412d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.955644 Oct 01 04:18:14.953757 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 11/30] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 1 04:18:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 1978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 04:18:14.985508 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e7fd497d-c235-46ae-bffd-bf93c9863c5d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:14.989245 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e7fd497d-c235-46ae-bffd-bf93c9863c5d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:15.019130 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7fd497d-c235-46ae-bffd-bf93c9863c5d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:15.036335 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7fd497d-c235-46ae-bffd-bf93c9863c5d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:15.043846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7fd497d-c235-46ae-bffd-bf93c9863c5d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:15.048403 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7fd497d-c235-46ae-bffd-bf93c9863c5d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:15.049780 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7fd497d-c235-46ae-bffd-bf93c9863c5d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:15.052755 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e7fd497d-c235-46ae-bffd-bf93c9863c5d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:15.134176 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-b82b3160-89e0-4f25-94f8-1d088cb66a14 req-0327a7c5-38d5-43fb-b130-fa5fa4346be0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dfb3a74-410c-431c-bbc1-4f8f6489b924", "tag": "03e60013-3f85-4d23-979a-41de21fce50c"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:18:15.199338 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b82b3160-89e0-4f25-94f8-1d088cb66a14 req-0327a7c5-38d5-43fb-b130-fa5fa4346be0 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:15.200776 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b82b3160-89e0-4f25-94f8-1d088cb66a14 req-0327a7c5-38d5-43fb-b130-fa5fa4346be0 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:15.202418 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b82b3160-89e0-4f25-94f8-1d088cb66a14 req-0327a7c5-38d5-43fb-b130-fa5fa4346be0 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:15.303100 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-b82b3160-89e0-4f25-94f8-1d088cb66a14 req-0327a7c5-38d5-43fb-b130-fa5fa4346be0 service nova] Creating event network-changed:03e60013-3f85-4d23-979a-41de21fce50c for instance 7dfb3a74-410c-431c-bbc1-4f8f6489b924 on hv-cinder-86004 Oct 01 04:18:15.304291 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b82b3160-89e0-4f25-94f8-1d088cb66a14 req-0327a7c5-38d5-43fb-b130-fa5fa4346be0 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 01 04:18:15.305470 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b82b3160-89e0-4f25-94f8-1d088cb66a14 req-0327a7c5-38d5-43fb-b130-fa5fa4346be0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 01 04:18:15.307850 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5c763f0-a9fc-4e40-9b43-f193e800d717 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:15.308535 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5c763f0-a9fc-4e40-9b43-f193e800d717 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:15.309978 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5c763f0-a9fc-4e40-9b43-f193e800d717 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:15.310965 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5c763f0-a9fc-4e40-9b43-f193e800d717 None None] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:15.311627 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5c763f0-a9fc-4e40-9b43-f193e800d717 None None] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:15.313946 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5c763f0-a9fc-4e40-9b43-f193e800d717 None None] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:15.330287 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-e7fd497d-c235-46ae-bffd-bf93c9863c5d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:15.350956 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.compute.rpcapi [None req-e5c763f0-a9fc-4e40-9b43-f193e800d717 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 01 04:18:15.356080 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e7fd497d-c235-46ae-bffd-bf93c9863c5d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1241 microversion: 2.1 time: 0.395317 Oct 01 04:18:15.362031 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 12/31] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:14 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1241 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:15.364754 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5c763f0-a9fc-4e40-9b43-f193e800d717 None None] Releasing lock "compute-rpcapi-router" {{(pid=120598) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 01 04:18:15.368661 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6db5bf43-5ad5-47c8-926e-c0ebaef609fa tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:15.373826 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6db5bf43-5ad5-47c8-926e-c0ebaef609fa tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:15.395503 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6db5bf43-5ad5-47c8-926e-c0ebaef609fa tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:15.396095 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6db5bf43-5ad5-47c8-926e-c0ebaef609fa tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:15.402359 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6db5bf43-5ad5-47c8-926e-c0ebaef609fa tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:15.404001 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6db5bf43-5ad5-47c8-926e-c0ebaef609fa tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:15.404701 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6db5bf43-5ad5-47c8-926e-c0ebaef609fa tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:15.405908 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6db5bf43-5ad5-47c8-926e-c0ebaef609fa tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:15.434368 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e5c763f0-a9fc-4e40-9b43-f193e800d717 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.708900 Oct 01 04:18:15.442261 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 20/32] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:18:15.463839 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7fdcda92-9986-496f-867d-b14f8177fa2a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:15.467215 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7fdcda92-9986-496f-867d-b14f8177fa2a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:15.604592 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-6db5bf43-5ad5-47c8-926e-c0ebaef609fa tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:15.623420 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-6db5bf43-5ad5-47c8-926e-c0ebaef609fa tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:15.628274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-6db5bf43-5ad5-47c8-926e-c0ebaef609fa tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:15.630342 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6db5bf43-5ad5-47c8-926e-c0ebaef609fa tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1286 microversion: 2.20 time: 0.267030 Oct 01 04:18:15.639064 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 13/33] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:15 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1286 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:18:15.740867 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-38a4f9c2-7c9d-4db3-9d72-ea201115e734 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:15.741535 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-38a4f9c2-7c9d-4db3-9d72-ea201115e734 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:15.758196 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7fdcda92-9986-496f-867d-b14f8177fa2a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:15.765678 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38a4f9c2-7c9d-4db3-9d72-ea201115e734 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:15.770644 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7fdcda92-9986-496f-867d-b14f8177fa2a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1222 microversion: 2.1 time: 0.326515 Oct 01 04:18:15.774392 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38a4f9c2-7c9d-4db3-9d72-ea201115e734 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:15.774852 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38a4f9c2-7c9d-4db3-9d72-ea201115e734 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:15.775608 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38a4f9c2-7c9d-4db3-9d72-ea201115e734 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:15.776230 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38a4f9c2-7c9d-4db3-9d72-ea201115e734 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:15.776356 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 21/34] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:15 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1222 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:15.800673 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38a4f9c2-7c9d-4db3-9d72-ea201115e734 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:16.362992 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-38a4f9c2-7c9d-4db3-9d72-ea201115e734 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:16.371953 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-38a4f9c2-7c9d-4db3-9d72-ea201115e734 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1315 microversion: 2.1 time: 0.635326 Oct 01 04:18:16.377644 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 14/35] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:15 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1315 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:18:16.396070 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0af4dd84-1cb6-4abd-a3fd-da91dedd326b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:16.399331 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0af4dd84-1cb6-4abd-a3fd-da91dedd326b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:16.409719 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0af4dd84-1cb6-4abd-a3fd-da91dedd326b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:16.411398 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0af4dd84-1cb6-4abd-a3fd-da91dedd326b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:16.420895 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0af4dd84-1cb6-4abd-a3fd-da91dedd326b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:16.422900 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0af4dd84-1cb6-4abd-a3fd-da91dedd326b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:16.423803 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0af4dd84-1cb6-4abd-a3fd-da91dedd326b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:16.424502 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0af4dd84-1cb6-4abd-a3fd-da91dedd326b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:16.556719 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0af4dd84-1cb6-4abd-a3fd-da91dedd326b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:16.570559 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0af4dd84-1cb6-4abd-a3fd-da91dedd326b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1289 microversion: 2.1 time: 0.181524 Oct 01 04:18:16.572848 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 22/36] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:16 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1289 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:16.673844 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7f08098a-8370-4ea1-9f16-260752859147 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:16.675284 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7f08098a-8370-4ea1-9f16-260752859147 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:16.712340 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f08098a-8370-4ea1-9f16-260752859147 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:16.713494 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f08098a-8370-4ea1-9f16-260752859147 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:16.715085 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f08098a-8370-4ea1-9f16-260752859147 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:16.716069 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f08098a-8370-4ea1-9f16-260752859147 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:16.717318 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f08098a-8370-4ea1-9f16-260752859147 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:16.717853 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f08098a-8370-4ea1-9f16-260752859147 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:16.804114 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1eb8b2b5-fc19-4050-9e3f-f2b11d945f7b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:16.804969 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1eb8b2b5-fc19-4050-9e3f-f2b11d945f7b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:16.817384 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1eb8b2b5-fc19-4050-9e3f-f2b11d945f7b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:16.820001 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1eb8b2b5-fc19-4050-9e3f-f2b11d945f7b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:16.823037 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1eb8b2b5-fc19-4050-9e3f-f2b11d945f7b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:16.825699 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1eb8b2b5-fc19-4050-9e3f-f2b11d945f7b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:16.826256 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1eb8b2b5-fc19-4050-9e3f-f2b11d945f7b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:16.826765 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1eb8b2b5-fc19-4050-9e3f-f2b11d945f7b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:16.839906 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-7f08098a-8370-4ea1-9f16-260752859147 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:16.850433 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-7f08098a-8370-4ea1-9f16-260752859147 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:16.852781 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-7f08098a-8370-4ea1-9f16-260752859147 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:16.854491 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7f08098a-8370-4ea1-9f16-260752859147 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1278 microversion: 2.20 time: 0.185507 Oct 01 04:18:16.855692 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 15/37] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:16 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1278 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:18:16.954800 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1eb8b2b5-fc19-4050-9e3f-f2b11d945f7b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:16.972986 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1eb8b2b5-fc19-4050-9e3f-f2b11d945f7b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1226 microversion: 2.1 time: 0.173341 Oct 01 04:18:16.974159 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 23/38] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:16 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1226 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:18:17.419635 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b3036e41-761f-4d0e-b0ec-8bd434657a9a tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:17.420557 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b3036e41-761f-4d0e-b0ec-8bd434657a9a tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:17.432736 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3036e41-761f-4d0e-b0ec-8bd434657a9a tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:17.434267 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3036e41-761f-4d0e-b0ec-8bd434657a9a tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:17.435136 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3036e41-761f-4d0e-b0ec-8bd434657a9a tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:17.436290 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3036e41-761f-4d0e-b0ec-8bd434657a9a tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:17.437183 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3036e41-761f-4d0e-b0ec-8bd434657a9a tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:17.438404 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3036e41-761f-4d0e-b0ec-8bd434657a9a tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:17.599972 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2df53f11-6973-4c3e-9c0f-9a35e5a61247 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:17.600690 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2df53f11-6973-4c3e-9c0f-9a35e5a61247 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:17.616526 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2df53f11-6973-4c3e-9c0f-9a35e5a61247 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:17.617329 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2df53f11-6973-4c3e-9c0f-9a35e5a61247 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:17.621510 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2df53f11-6973-4c3e-9c0f-9a35e5a61247 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:17.622545 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2df53f11-6973-4c3e-9c0f-9a35e5a61247 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:17.623186 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2df53f11-6973-4c3e-9c0f-9a35e5a61247 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:17.629520 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2df53f11-6973-4c3e-9c0f-9a35e5a61247 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:17.791765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-b3036e41-761f-4d0e-b0ec-8bd434657a9a tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:17.806403 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b3036e41-761f-4d0e-b0ec-8bd434657a9a tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1315 microversion: 2.1 time: 0.391341 Oct 01 04:18:17.820963 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 16/39] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:17 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:17.844708 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2df53f11-6973-4c3e-9c0f-9a35e5a61247 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:17.866192 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2df53f11-6973-4c3e-9c0f-9a35e5a61247 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1289 microversion: 2.1 time: 0.270164 Oct 01 04:18:17.866790 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 24/40] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:17 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1289 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:17.886571 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-15e48719-f343-4b8f-879d-861fccfed12f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:17.887383 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-15e48719-f343-4b8f-879d-861fccfed12f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:17.907547 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-15e48719-f343-4b8f-879d-861fccfed12f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:17.908269 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-15e48719-f343-4b8f-879d-861fccfed12f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:17.908880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-15e48719-f343-4b8f-879d-861fccfed12f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:17.909790 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-15e48719-f343-4b8f-879d-861fccfed12f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:17.910477 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-15e48719-f343-4b8f-879d-861fccfed12f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:17.911177 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-15e48719-f343-4b8f-879d-861fccfed12f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:18.006955 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aa5270bc-c135-421b-b2a0-81f8b9844bde tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:18.009132 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aa5270bc-c135-421b-b2a0-81f8b9844bde tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:18.015148 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa5270bc-c135-421b-b2a0-81f8b9844bde tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:18.016258 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa5270bc-c135-421b-b2a0-81f8b9844bde tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:18.017128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa5270bc-c135-421b-b2a0-81f8b9844bde tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:18.018195 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa5270bc-c135-421b-b2a0-81f8b9844bde tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:18.018954 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa5270bc-c135-421b-b2a0-81f8b9844bde tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:18.019635 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aa5270bc-c135-421b-b2a0-81f8b9844bde tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:18.061833 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-15e48719-f343-4b8f-879d-861fccfed12f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:18.080137 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-15e48719-f343-4b8f-879d-861fccfed12f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:18.083855 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-15e48719-f343-4b8f-879d-861fccfed12f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:18.086762 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-15e48719-f343-4b8f-879d-861fccfed12f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1278 microversion: 2.20 time: 0.204459 Oct 01 04:18:18.106036 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 17/41] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:17 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1278 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:18:18.128887 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-aa5270bc-c135-421b-b2a0-81f8b9844bde tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:18.142200 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aa5270bc-c135-421b-b2a0-81f8b9844bde tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1226 microversion: 2.1 time: 0.139066 Oct 01 04:18:18.157340 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 25/42] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:18 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1226 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:18:18.837305 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1ca20bea-d420-478c-9db0-470870f5bbbe tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:18.838607 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1ca20bea-d420-478c-9db0-470870f5bbbe tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:18.854904 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ca20bea-d420-478c-9db0-470870f5bbbe tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:18.856047 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ca20bea-d420-478c-9db0-470870f5bbbe tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:18.856745 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ca20bea-d420-478c-9db0-470870f5bbbe tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:18.857841 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ca20bea-d420-478c-9db0-470870f5bbbe tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:18.858522 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ca20bea-d420-478c-9db0-470870f5bbbe tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:18.859201 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1ca20bea-d420-478c-9db0-470870f5bbbe tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:18.892566 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7344e115-ffbb-4f77-8241-2f431158866d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:18.893223 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7344e115-ffbb-4f77-8241-2f431158866d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:18.903204 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7344e115-ffbb-4f77-8241-2f431158866d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:18.904071 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7344e115-ffbb-4f77-8241-2f431158866d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:18.905161 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7344e115-ffbb-4f77-8241-2f431158866d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:18.906429 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7344e115-ffbb-4f77-8241-2f431158866d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:18.909658 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7344e115-ffbb-4f77-8241-2f431158866d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:18.910384 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7344e115-ffbb-4f77-8241-2f431158866d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:19.051275 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7344e115-ffbb-4f77-8241-2f431158866d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:19.063092 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7344e115-ffbb-4f77-8241-2f431158866d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1289 microversion: 2.1 time: 0.175165 Oct 01 04:18:19.064718 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 26/43] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:18 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1289 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:19.079884 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-1ca20bea-d420-478c-9db0-470870f5bbbe tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:19.088671 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1ca20bea-d420-478c-9db0-470870f5bbbe tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1315 microversion: 2.1 time: 0.255837 Oct 01 04:18:19.089251 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 18/44] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:18 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:19.118993 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ceaca9c4-1563-430f-b472-cd7657deab28 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:19.120152 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ceaca9c4-1563-430f-b472-cd7657deab28 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:19.129175 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ceaca9c4-1563-430f-b472-cd7657deab28 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:19.130069 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ceaca9c4-1563-430f-b472-cd7657deab28 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:19.130726 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ceaca9c4-1563-430f-b472-cd7657deab28 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:19.131813 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ceaca9c4-1563-430f-b472-cd7657deab28 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:19.132636 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ceaca9c4-1563-430f-b472-cd7657deab28 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:19.133558 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ceaca9c4-1563-430f-b472-cd7657deab28 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:19.165819 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-63208f43-7e7d-4ae6-a804-95c4d7f7edc6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:19.166777 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-63208f43-7e7d-4ae6-a804-95c4d7f7edc6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:19.178065 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63208f43-7e7d-4ae6-a804-95c4d7f7edc6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:19.180915 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63208f43-7e7d-4ae6-a804-95c4d7f7edc6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:19.197106 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63208f43-7e7d-4ae6-a804-95c4d7f7edc6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:19.197923 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63208f43-7e7d-4ae6-a804-95c4d7f7edc6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:19.199935 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63208f43-7e7d-4ae6-a804-95c4d7f7edc6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:19.200589 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-63208f43-7e7d-4ae6-a804-95c4d7f7edc6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:19.244339 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ceaca9c4-1563-430f-b472-cd7657deab28 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:19.256358 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ceaca9c4-1563-430f-b472-cd7657deab28 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:19.258555 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ceaca9c4-1563-430f-b472-cd7657deab28 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:19.259988 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ceaca9c4-1563-430f-b472-cd7657deab28 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1278 microversion: 2.20 time: 0.147193 Oct 01 04:18:19.274242 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 27/45] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:19 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:18:19.330979 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-63208f43-7e7d-4ae6-a804-95c4d7f7edc6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:19.350701 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-63208f43-7e7d-4ae6-a804-95c4d7f7edc6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1226 microversion: 2.1 time: 0.188698 Oct 01 04:18:19.355343 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 19/46] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:19 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1226 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:20.090674 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b359e536-cafc-47d4-84ec-d1a5722e1d63 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:20.091692 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b359e536-cafc-47d4-84ec-d1a5722e1d63 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:20.102849 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b359e536-cafc-47d4-84ec-d1a5722e1d63 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:20.103979 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b359e536-cafc-47d4-84ec-d1a5722e1d63 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:20.104816 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b359e536-cafc-47d4-84ec-d1a5722e1d63 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:20.106264 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b359e536-cafc-47d4-84ec-d1a5722e1d63 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:20.107002 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b359e536-cafc-47d4-84ec-d1a5722e1d63 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:20.107695 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b359e536-cafc-47d4-84ec-d1a5722e1d63 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:20.119689 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ffd4f6e6-9209-4300-85d9-0f68251ec139 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:20.120957 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ffd4f6e6-9209-4300-85d9-0f68251ec139 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:20.129957 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ffd4f6e6-9209-4300-85d9-0f68251ec139 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:20.130777 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ffd4f6e6-9209-4300-85d9-0f68251ec139 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:20.131308 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ffd4f6e6-9209-4300-85d9-0f68251ec139 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:20.132233 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ffd4f6e6-9209-4300-85d9-0f68251ec139 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:20.137897 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ffd4f6e6-9209-4300-85d9-0f68251ec139 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:20.139789 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ffd4f6e6-9209-4300-85d9-0f68251ec139 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:20.238774 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b359e536-cafc-47d4-84ec-d1a5722e1d63 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:20.252259 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b359e536-cafc-47d4-84ec-d1a5722e1d63 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1289 microversion: 2.1 time: 0.167618 Oct 01 04:18:20.258570 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 28/47] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:20 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1289 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:20.292631 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-81a9ae58-9003-4549-88ed-8f36e82e66e2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:20.293863 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-81a9ae58-9003-4549-88ed-8f36e82e66e2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:20.304920 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81a9ae58-9003-4549-88ed-8f36e82e66e2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:20.305508 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81a9ae58-9003-4549-88ed-8f36e82e66e2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:20.305955 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81a9ae58-9003-4549-88ed-8f36e82e66e2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:20.306693 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81a9ae58-9003-4549-88ed-8f36e82e66e2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:20.307606 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81a9ae58-9003-4549-88ed-8f36e82e66e2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:20.308038 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81a9ae58-9003-4549-88ed-8f36e82e66e2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:20.391501 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-ffd4f6e6-9209-4300-85d9-0f68251ec139 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:20.399599 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ffd4f6e6-9209-4300-85d9-0f68251ec139 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1315 microversion: 2.1 time: 0.287720 Oct 01 04:18:20.400830 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 20/48] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:20 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:20.407672 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-81a9ae58-9003-4549-88ed-8f36e82e66e2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:20.416296 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-327b8a1c-f71b-487e-979c-fe44a7ddae3d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:20.417760 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-327b8a1c-f71b-487e-979c-fe44a7ddae3d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:20.420025 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-81a9ae58-9003-4549-88ed-8f36e82e66e2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:20.422176 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-81a9ae58-9003-4549-88ed-8f36e82e66e2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:20.423303 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-81a9ae58-9003-4549-88ed-8f36e82e66e2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1278 microversion: 2.20 time: 0.138575 Oct 01 04:18:20.423868 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 29/49] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:20 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1278 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:18:20.426612 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-327b8a1c-f71b-487e-979c-fe44a7ddae3d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:20.427210 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-327b8a1c-f71b-487e-979c-fe44a7ddae3d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:20.428734 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-327b8a1c-f71b-487e-979c-fe44a7ddae3d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:20.429598 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-327b8a1c-f71b-487e-979c-fe44a7ddae3d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:20.430262 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-327b8a1c-f71b-487e-979c-fe44a7ddae3d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:20.430911 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-327b8a1c-f71b-487e-979c-fe44a7ddae3d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:20.515634 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-327b8a1c-f71b-487e-979c-fe44a7ddae3d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:20.528523 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-327b8a1c-f71b-487e-979c-fe44a7ddae3d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1226 microversion: 2.1 time: 0.126025 Oct 01 04:18:20.529995 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 21/50] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:20 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1226 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:21.280376 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a2bae500-4ee7-4e8b-9681-05c6aee9af64 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:21.282155 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a2bae500-4ee7-4e8b-9681-05c6aee9af64 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:21.288245 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2bae500-4ee7-4e8b-9681-05c6aee9af64 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:21.288737 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2bae500-4ee7-4e8b-9681-05c6aee9af64 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:21.289212 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2bae500-4ee7-4e8b-9681-05c6aee9af64 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:21.290167 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2bae500-4ee7-4e8b-9681-05c6aee9af64 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:21.290793 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2bae500-4ee7-4e8b-9681-05c6aee9af64 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:21.291466 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2bae500-4ee7-4e8b-9681-05c6aee9af64 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:21.378941 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a2bae500-4ee7-4e8b-9681-05c6aee9af64 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:21.389200 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a2bae500-4ee7-4e8b-9681-05c6aee9af64 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1289 microversion: 2.1 time: 0.113477 Oct 01 04:18:21.390298 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 30/51] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:21 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1289 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:21.428337 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-14fb46c0-e214-4f18-a498-d9759c2b1ef1 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:21.429034 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-14fb46c0-e214-4f18-a498-d9759c2b1ef1 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:21.435906 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14fb46c0-e214-4f18-a498-d9759c2b1ef1 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:21.438085 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14fb46c0-e214-4f18-a498-d9759c2b1ef1 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:21.438085 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14fb46c0-e214-4f18-a498-d9759c2b1ef1 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:21.438759 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14fb46c0-e214-4f18-a498-d9759c2b1ef1 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:21.439296 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14fb46c0-e214-4f18-a498-d9759c2b1ef1 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:21.440633 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14fb46c0-e214-4f18-a498-d9759c2b1ef1 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:21.457219 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e08b711a-d98a-47cc-a8a7-71a52134bd91 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:21.458293 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e08b711a-d98a-47cc-a8a7-71a52134bd91 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:21.465680 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e08b711a-d98a-47cc-a8a7-71a52134bd91 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:21.466428 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e08b711a-d98a-47cc-a8a7-71a52134bd91 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:21.466866 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e08b711a-d98a-47cc-a8a7-71a52134bd91 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:21.467732 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e08b711a-d98a-47cc-a8a7-71a52134bd91 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:21.469103 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e08b711a-d98a-47cc-a8a7-71a52134bd91 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:21.469752 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e08b711a-d98a-47cc-a8a7-71a52134bd91 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:21.588314 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e08b711a-d98a-47cc-a8a7-71a52134bd91 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:21.598754 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e08b711a-d98a-47cc-a8a7-71a52134bd91 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:21.600837 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e08b711a-d98a-47cc-a8a7-71a52134bd91 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:21.602555 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e08b711a-d98a-47cc-a8a7-71a52134bd91 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1278 microversion: 2.20 time: 0.151469 Oct 01 04:18:21.605381 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 31/52] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:21 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:18:21.613067 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a607a33d-4a38-4de6-9723-9504c79ceb11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:21.614096 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a607a33d-4a38-4de6-9723-9504c79ceb11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:21.622968 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a607a33d-4a38-4de6-9723-9504c79ceb11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:21.623462 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a607a33d-4a38-4de6-9723-9504c79ceb11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:21.623904 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a607a33d-4a38-4de6-9723-9504c79ceb11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:21.625484 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a607a33d-4a38-4de6-9723-9504c79ceb11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:21.625966 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a607a33d-4a38-4de6-9723-9504c79ceb11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:21.626675 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a607a33d-4a38-4de6-9723-9504c79ceb11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:21.740451 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a607a33d-4a38-4de6-9723-9504c79ceb11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:21.775148 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a607a33d-4a38-4de6-9723-9504c79ceb11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1226 microversion: 2.1 time: 0.167683 Oct 01 04:18:21.782650 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 32/53] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:21 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1226 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:21.800626 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-14fb46c0-e214-4f18-a498-d9759c2b1ef1 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:21.811434 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-14fb46c0-e214-4f18-a498-d9759c2b1ef1 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1315 microversion: 2.1 time: 0.386659 Oct 01 04:18:21.821027 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 22/54] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:21 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:22.415866 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9d621e71-772c-4c40-a807-fb96e2244539 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:22.415866 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9d621e71-772c-4c40-a807-fb96e2244539 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:22.420742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d621e71-772c-4c40-a807-fb96e2244539 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:22.421260 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d621e71-772c-4c40-a807-fb96e2244539 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:22.421876 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d621e71-772c-4c40-a807-fb96e2244539 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:22.422856 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d621e71-772c-4c40-a807-fb96e2244539 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:22.423319 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d621e71-772c-4c40-a807-fb96e2244539 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:22.423735 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9d621e71-772c-4c40-a807-fb96e2244539 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:22.493816 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-9d621e71-772c-4c40-a807-fb96e2244539 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:22.498557 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:22.507652 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9d621e71-772c-4c40-a807-fb96e2244539 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1289 microversion: 2.1 time: 0.095914 Oct 01 04:18:22.507652 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 33/55] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:22 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1289 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:18:22.633427 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e2cf837f-57bc-4ef4-a43d-b39c6e4fb43b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:22.634039 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e2cf837f-57bc-4ef4-a43d-b39c6e4fb43b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:22.641221 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e2cf837f-57bc-4ef4-a43d-b39c6e4fb43b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:22.641825 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e2cf837f-57bc-4ef4-a43d-b39c6e4fb43b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:22.642362 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e2cf837f-57bc-4ef4-a43d-b39c6e4fb43b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:22.643390 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e2cf837f-57bc-4ef4-a43d-b39c6e4fb43b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:22.643927 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e2cf837f-57bc-4ef4-a43d-b39c6e4fb43b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:22.644445 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e2cf837f-57bc-4ef4-a43d-b39c6e4fb43b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:22.723592 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-e2cf837f-57bc-4ef4-a43d-b39c6e4fb43b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:22.731934 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-e2cf837f-57bc-4ef4-a43d-b39c6e4fb43b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:22.733888 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-e2cf837f-57bc-4ef4-a43d-b39c6e4fb43b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:22.735651 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e2cf837f-57bc-4ef4-a43d-b39c6e4fb43b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1278 microversion: 2.20 time: 0.106446 Oct 01 04:18:22.737019 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 23/56] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:22 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1278 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:18:22.800642 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8660fffa-f193-40e0-a5d5-48893d1ea0a3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:22.801334 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8660fffa-f193-40e0-a5d5-48893d1ea0a3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:22.811297 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:22.814304 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8660fffa-f193-40e0-a5d5-48893d1ea0a3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:22.814997 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8660fffa-f193-40e0-a5d5-48893d1ea0a3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:22.815321 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8660fffa-f193-40e0-a5d5-48893d1ea0a3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:22.816038 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8660fffa-f193-40e0-a5d5-48893d1ea0a3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:22.816498 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8660fffa-f193-40e0-a5d5-48893d1ea0a3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:22.816941 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8660fffa-f193-40e0-a5d5-48893d1ea0a3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:22.837381 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bb4142a8-b7e6-4e98-b9b0-49da1fd51a62 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:22.838488 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bb4142a8-b7e6-4e98-b9b0-49da1fd51a62 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:22.850390 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb4142a8-b7e6-4e98-b9b0-49da1fd51a62 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:22.853063 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb4142a8-b7e6-4e98-b9b0-49da1fd51a62 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:22.853833 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb4142a8-b7e6-4e98-b9b0-49da1fd51a62 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:22.855200 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb4142a8-b7e6-4e98-b9b0-49da1fd51a62 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:22.856099 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb4142a8-b7e6-4e98-b9b0-49da1fd51a62 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:22.856893 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb4142a8-b7e6-4e98-b9b0-49da1fd51a62 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:22.930987 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8660fffa-f193-40e0-a5d5-48893d1ea0a3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:22.945109 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8660fffa-f193-40e0-a5d5-48893d1ea0a3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1226 microversion: 2.1 time: 0.146330 Oct 01 04:18:22.956952 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 34/57] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:22 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1226 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:23.065943 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-bb4142a8-b7e6-4e98-b9b0-49da1fd51a62 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:23.074011 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bb4142a8-b7e6-4e98-b9b0-49da1fd51a62 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1315 microversion: 2.1 time: 0.241256 Oct 01 04:18:23.076768 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 24/58] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:22 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:18:23.532339 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5567d811-1582-4b2c-a72e-28aa2763a23c tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:23.533499 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5567d811-1582-4b2c-a72e-28aa2763a23c tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:23.539348 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5567d811-1582-4b2c-a72e-28aa2763a23c tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:23.539946 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5567d811-1582-4b2c-a72e-28aa2763a23c tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:23.540256 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5567d811-1582-4b2c-a72e-28aa2763a23c tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:23.541299 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5567d811-1582-4b2c-a72e-28aa2763a23c tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:23.542081 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5567d811-1582-4b2c-a72e-28aa2763a23c tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:23.542509 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5567d811-1582-4b2c-a72e-28aa2763a23c tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:23.608503 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-5567d811-1582-4b2c-a72e-28aa2763a23c tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:23.617233 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5567d811-1582-4b2c-a72e-28aa2763a23c tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1295 microversion: 2.1 time: 0.091132 Oct 01 04:18:23.617895 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 35/59] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:23 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1295 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:23.763314 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-16179089-7622-4af9-82d6-29f5cbd3ed3b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:23.764677 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-16179089-7622-4af9-82d6-29f5cbd3ed3b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:23.771496 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16179089-7622-4af9-82d6-29f5cbd3ed3b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:23.772313 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16179089-7622-4af9-82d6-29f5cbd3ed3b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:23.772764 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16179089-7622-4af9-82d6-29f5cbd3ed3b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:23.773685 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16179089-7622-4af9-82d6-29f5cbd3ed3b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:23.774302 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16179089-7622-4af9-82d6-29f5cbd3ed3b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:23.775654 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-16179089-7622-4af9-82d6-29f5cbd3ed3b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:23.861674 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-16179089-7622-4af9-82d6-29f5cbd3ed3b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:23.866119 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:23.873073 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-16179089-7622-4af9-82d6-29f5cbd3ed3b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:23.874715 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-16179089-7622-4af9-82d6-29f5cbd3ed3b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:23.876023 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-16179089-7622-4af9-82d6-29f5cbd3ed3b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1278 microversion: 2.20 time: 0.116777 Oct 01 04:18:23.876738 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 25/60] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:23 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1278 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:18:23.969928 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-405fcaff-a9b0-4810-acc5-74c7d7938869 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:23.970536 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-405fcaff-a9b0-4810-acc5-74c7d7938869 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:23.976369 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-405fcaff-a9b0-4810-acc5-74c7d7938869 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:23.976839 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-405fcaff-a9b0-4810-acc5-74c7d7938869 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:23.977300 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-405fcaff-a9b0-4810-acc5-74c7d7938869 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:23.977995 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-405fcaff-a9b0-4810-acc5-74c7d7938869 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:23.978441 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-405fcaff-a9b0-4810-acc5-74c7d7938869 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:23.979041 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-405fcaff-a9b0-4810-acc5-74c7d7938869 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:24.053727 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-405fcaff-a9b0-4810-acc5-74c7d7938869 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:24.061452 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-405fcaff-a9b0-4810-acc5-74c7d7938869 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1218 microversion: 2.1 time: 0.095293 Oct 01 04:18:24.063956 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 36/61] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:23 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:24.097602 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9b553b04-5178-4f8e-8091-6b48d0be37e6 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:24.098220 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9b553b04-5178-4f8e-8091-6b48d0be37e6 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:24.104573 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b553b04-5178-4f8e-8091-6b48d0be37e6 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:24.105093 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b553b04-5178-4f8e-8091-6b48d0be37e6 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:24.105535 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b553b04-5178-4f8e-8091-6b48d0be37e6 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:24.113102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b553b04-5178-4f8e-8091-6b48d0be37e6 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:24.115032 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b553b04-5178-4f8e-8091-6b48d0be37e6 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:24.115641 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9b553b04-5178-4f8e-8091-6b48d0be37e6 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:24.303086 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-9b553b04-5178-4f8e-8091-6b48d0be37e6 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:24.316671 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9b553b04-5178-4f8e-8091-6b48d0be37e6 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1315 microversion: 2.1 time: 0.223485 Oct 01 04:18:24.328951 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 26/62] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:24 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:24.641549 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-50f696eb-d7e3-4dba-9d58-c79154c24461 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:24.642166 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-50f696eb-d7e3-4dba-9d58-c79154c24461 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:24.649920 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50f696eb-d7e3-4dba-9d58-c79154c24461 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:24.650405 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50f696eb-d7e3-4dba-9d58-c79154c24461 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:24.651718 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50f696eb-d7e3-4dba-9d58-c79154c24461 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:24.652418 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50f696eb-d7e3-4dba-9d58-c79154c24461 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:24.653057 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50f696eb-d7e3-4dba-9d58-c79154c24461 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:24.653492 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-50f696eb-d7e3-4dba-9d58-c79154c24461 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:24.777238 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-50f696eb-d7e3-4dba-9d58-c79154c24461 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:24.785847 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-50f696eb-d7e3-4dba-9d58-c79154c24461 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1295 microversion: 2.1 time: 0.149032 Oct 01 04:18:24.786834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 37/63] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:24 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1295 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:24.905726 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-92e613c3-9376-49e3-aefa-d26c8d222ff1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:24.906338 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-92e613c3-9376-49e3-aefa-d26c8d222ff1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:24.913052 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:24.913900 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=12 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:24.915624 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-92e613c3-9376-49e3-aefa-d26c8d222ff1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:24.916108 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-92e613c3-9376-49e3-aefa-d26c8d222ff1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:24.916589 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-92e613c3-9376-49e3-aefa-d26c8d222ff1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:24.917287 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-92e613c3-9376-49e3-aefa-d26c8d222ff1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:24.917895 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-92e613c3-9376-49e3-aefa-d26c8d222ff1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:24.918983 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-92e613c3-9376-49e3-aefa-d26c8d222ff1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:25.014960 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-92e613c3-9376-49e3-aefa-d26c8d222ff1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:25.024075 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-92e613c3-9376-49e3-aefa-d26c8d222ff1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:25.025752 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-92e613c3-9376-49e3-aefa-d26c8d222ff1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:25.027266 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-92e613c3-9376-49e3-aefa-d26c8d222ff1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1278 microversion: 2.20 time: 0.129648 Oct 01 04:18:25.028338 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 27/64] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:24 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1278 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:18:25.087856 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7b026424-e743-41a3-82ec-6d5f7dee7990 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:25.088539 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7b026424-e743-41a3-82ec-6d5f7dee7990 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:25.106826 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b026424-e743-41a3-82ec-6d5f7dee7990 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:25.107323 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b026424-e743-41a3-82ec-6d5f7dee7990 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:25.107757 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b026424-e743-41a3-82ec-6d5f7dee7990 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:25.108465 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b026424-e743-41a3-82ec-6d5f7dee7990 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:25.109643 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b026424-e743-41a3-82ec-6d5f7dee7990 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:25.110251 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b026424-e743-41a3-82ec-6d5f7dee7990 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:25.196304 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7b026424-e743-41a3-82ec-6d5f7dee7990 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:25.207938 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7b026424-e743-41a3-82ec-6d5f7dee7990 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1218 microversion: 2.1 time: 0.124355 Oct 01 04:18:25.222720 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 38/65] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:25 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1218 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:25.343247 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2e34ec01-6334-4b98-9cdd-62b461793ae1 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:25.344280 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2e34ec01-6334-4b98-9cdd-62b461793ae1 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:25.351024 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e34ec01-6334-4b98-9cdd-62b461793ae1 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:25.351517 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e34ec01-6334-4b98-9cdd-62b461793ae1 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:25.351953 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e34ec01-6334-4b98-9cdd-62b461793ae1 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:25.352821 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e34ec01-6334-4b98-9cdd-62b461793ae1 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:25.353309 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e34ec01-6334-4b98-9cdd-62b461793ae1 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:25.353913 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e34ec01-6334-4b98-9cdd-62b461793ae1 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:25.540644 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-2e34ec01-6334-4b98-9cdd-62b461793ae1 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:25.554273 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2e34ec01-6334-4b98-9cdd-62b461793ae1 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1315 microversion: 2.1 time: 0.216102 Oct 01 04:18:25.554857 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 28/66] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:25 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:25.809148 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b1d27c70-85c5-40f5-894f-fa8ee9bb3ef3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:25.809755 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b1d27c70-85c5-40f5-894f-fa8ee9bb3ef3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:25.811576 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:25.813534 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=26 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:25.818712 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1d27c70-85c5-40f5-894f-fa8ee9bb3ef3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:25.819199 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1d27c70-85c5-40f5-894f-fa8ee9bb3ef3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:25.819629 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1d27c70-85c5-40f5-894f-fa8ee9bb3ef3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:25.820329 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1d27c70-85c5-40f5-894f-fa8ee9bb3ef3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:25.820777 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1d27c70-85c5-40f5-894f-fa8ee9bb3ef3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:25.821225 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1d27c70-85c5-40f5-894f-fa8ee9bb3ef3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:25.890249 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b1d27c70-85c5-40f5-894f-fa8ee9bb3ef3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:25.915776 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b1d27c70-85c5-40f5-894f-fa8ee9bb3ef3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1295 microversion: 2.1 time: 0.109089 Oct 01 04:18:25.917569 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 39/67] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:25 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1295 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:26.053915 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-53a63fe4-6d52-4559-b54f-12bd6b1fb6bc tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:26.054702 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-53a63fe4-6d52-4559-b54f-12bd6b1fb6bc tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:26.066600 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-53a63fe4-6d52-4559-b54f-12bd6b1fb6bc tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:26.069243 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-53a63fe4-6d52-4559-b54f-12bd6b1fb6bc tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:26.070696 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-53a63fe4-6d52-4559-b54f-12bd6b1fb6bc tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:26.073884 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-53a63fe4-6d52-4559-b54f-12bd6b1fb6bc tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:26.074558 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-53a63fe4-6d52-4559-b54f-12bd6b1fb6bc tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:26.075692 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-53a63fe4-6d52-4559-b54f-12bd6b1fb6bc tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:26.186180 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-53a63fe4-6d52-4559-b54f-12bd6b1fb6bc tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:26.198046 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-53a63fe4-6d52-4559-b54f-12bd6b1fb6bc tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:26.199905 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-53a63fe4-6d52-4559-b54f-12bd6b1fb6bc tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:26.200992 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-53a63fe4-6d52-4559-b54f-12bd6b1fb6bc tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1278 microversion: 2.20 time: 0.152145 Oct 01 04:18:26.202216 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 29/68] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:26 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:18:26.235191 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e02eeca6-ce31-41c9-9b7c-a442c2348a70 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:26.235947 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e02eeca6-ce31-41c9-9b7c-a442c2348a70 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:26.248520 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e02eeca6-ce31-41c9-9b7c-a442c2348a70 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:26.251408 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e02eeca6-ce31-41c9-9b7c-a442c2348a70 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:26.253336 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e02eeca6-ce31-41c9-9b7c-a442c2348a70 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:26.255693 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e02eeca6-ce31-41c9-9b7c-a442c2348a70 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:26.256445 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e02eeca6-ce31-41c9-9b7c-a442c2348a70 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:26.257053 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e02eeca6-ce31-41c9-9b7c-a442c2348a70 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:26.352394 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e02eeca6-ce31-41c9-9b7c-a442c2348a70 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:26.364403 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e02eeca6-ce31-41c9-9b7c-a442c2348a70 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1218 microversion: 2.1 time: 0.136201 Oct 01 04:18:26.378924 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 40/69] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:26 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1218 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:26.583377 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8b264893-98f1-4b21-800c-c3a7a3baef5e tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:26.584311 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8b264893-98f1-4b21-800c-c3a7a3baef5e tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:26.588330 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:26.611169 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b264893-98f1-4b21-800c-c3a7a3baef5e tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:26.612757 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b264893-98f1-4b21-800c-c3a7a3baef5e tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:26.613878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b264893-98f1-4b21-800c-c3a7a3baef5e tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:26.615972 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b264893-98f1-4b21-800c-c3a7a3baef5e tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:26.617074 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b264893-98f1-4b21-800c-c3a7a3baef5e tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:26.618093 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8b264893-98f1-4b21-800c-c3a7a3baef5e tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:26.940875 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a5a45809-ea77-400c-8aa9-8ad03388181d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:26.941655 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a5a45809-ea77-400c-8aa9-8ad03388181d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:26.950958 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5a45809-ea77-400c-8aa9-8ad03388181d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:26.962097 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5a45809-ea77-400c-8aa9-8ad03388181d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:26.962773 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5a45809-ea77-400c-8aa9-8ad03388181d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:26.964437 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5a45809-ea77-400c-8aa9-8ad03388181d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:26.965382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5a45809-ea77-400c-8aa9-8ad03388181d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:26.965998 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5a45809-ea77-400c-8aa9-8ad03388181d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:27.014454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-8b264893-98f1-4b21-800c-c3a7a3baef5e tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:27.040685 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8b264893-98f1-4b21-800c-c3a7a3baef5e tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1315 microversion: 2.1 time: 0.461595 Oct 01 04:18:27.043084 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 30/70] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:26 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:27.227073 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-03af33d3-154b-4475-8bbb-57cdcee06c1b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:27.228558 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-03af33d3-154b-4475-8bbb-57cdcee06c1b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:27.235793 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03af33d3-154b-4475-8bbb-57cdcee06c1b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:27.243202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03af33d3-154b-4475-8bbb-57cdcee06c1b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:27.243664 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03af33d3-154b-4475-8bbb-57cdcee06c1b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:27.244464 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03af33d3-154b-4475-8bbb-57cdcee06c1b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:27.244888 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03af33d3-154b-4475-8bbb-57cdcee06c1b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:27.245357 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03af33d3-154b-4475-8bbb-57cdcee06c1b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:27.547130 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-03af33d3-154b-4475-8bbb-57cdcee06c1b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:27.563735 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-03af33d3-154b-4475-8bbb-57cdcee06c1b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:27.565487 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-03af33d3-154b-4475-8bbb-57cdcee06c1b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:27.566716 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-03af33d3-154b-4475-8bbb-57cdcee06c1b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1278 microversion: 2.20 time: 0.343546 Oct 01 04:18:27.569274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 31/71] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:27 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1278 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:18:27.582283 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0d6bfeaa-0a94-4623-8f3b-185e9f32e4ff tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:27.583714 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0d6bfeaa-0a94-4623-8f3b-185e9f32e4ff tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:27.600011 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d6bfeaa-0a94-4623-8f3b-185e9f32e4ff tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:27.600574 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d6bfeaa-0a94-4623-8f3b-185e9f32e4ff tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:27.601127 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d6bfeaa-0a94-4623-8f3b-185e9f32e4ff tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:27.601989 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d6bfeaa-0a94-4623-8f3b-185e9f32e4ff tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:27.602445 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d6bfeaa-0a94-4623-8f3b-185e9f32e4ff tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:27.602864 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0d6bfeaa-0a94-4623-8f3b-185e9f32e4ff tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:27.644326 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a5a45809-ea77-400c-8aa9-8ad03388181d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:27.657502 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a5a45809-ea77-400c-8aa9-8ad03388181d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1363 microversion: 2.1 time: 0.720567 Oct 01 04:18:27.659945 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 41/72] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:26 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1363 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:27.783455 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-0d6bfeaa-0a94-4623-8f3b-185e9f32e4ff tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:27.793139 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0d6bfeaa-0a94-4623-8f3b-185e9f32e4ff tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1218 microversion: 2.1 time: 0.219363 Oct 01 04:18:27.794121 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 32/73] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:27 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1218 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:28.071703 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2abcf4aa-1ab2-43cb-bfd4-14e49593b6f2 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:28.071703 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2abcf4aa-1ab2-43cb-bfd4-14e49593b6f2 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:28.077903 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2abcf4aa-1ab2-43cb-bfd4-14e49593b6f2 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:28.079171 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2abcf4aa-1ab2-43cb-bfd4-14e49593b6f2 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:28.079951 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2abcf4aa-1ab2-43cb-bfd4-14e49593b6f2 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:28.081095 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2abcf4aa-1ab2-43cb-bfd4-14e49593b6f2 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:28.081766 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2abcf4aa-1ab2-43cb-bfd4-14e49593b6f2 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:28.082447 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2abcf4aa-1ab2-43cb-bfd4-14e49593b6f2 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:28.595351 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-af31b854-aecb-49ad-9400-1c2e1164ac3a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:28.596755 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-af31b854-aecb-49ad-9400-1c2e1164ac3a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:28.613873 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af31b854-aecb-49ad-9400-1c2e1164ac3a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:28.645213 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af31b854-aecb-49ad-9400-1c2e1164ac3a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:28.646077 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af31b854-aecb-49ad-9400-1c2e1164ac3a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:28.648400 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af31b854-aecb-49ad-9400-1c2e1164ac3a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:28.652021 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af31b854-aecb-49ad-9400-1c2e1164ac3a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:28.662115 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af31b854-aecb-49ad-9400-1c2e1164ac3a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:28.675305 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2abcf4aa-1ab2-43cb-bfd4-14e49593b6f2 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:28.694000 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2abcf4aa-1ab2-43cb-bfd4-14e49593b6f2 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1315 microversion: 2.1 time: 0.627767 Oct 01 04:18:28.696264 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 42/74] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:28 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1315 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:28.704839 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5296992b-f08b-4113-b3a4-4de0c94f4647 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:28.706126 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5296992b-f08b-4113-b3a4-4de0c94f4647 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:28.713555 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5296992b-f08b-4113-b3a4-4de0c94f4647 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:28.714227 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5296992b-f08b-4113-b3a4-4de0c94f4647 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:28.714826 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5296992b-f08b-4113-b3a4-4de0c94f4647 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:28.715670 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5296992b-f08b-4113-b3a4-4de0c94f4647 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:28.716277 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5296992b-f08b-4113-b3a4-4de0c94f4647 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:28.717552 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5296992b-f08b-4113-b3a4-4de0c94f4647 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:28.806781 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-af31b854-aecb-49ad-9400-1c2e1164ac3a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:28.825266 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-af31b854-aecb-49ad-9400-1c2e1164ac3a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:28.828430 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-af31b854-aecb-49ad-9400-1c2e1164ac3a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:28.830903 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-af31b854-aecb-49ad-9400-1c2e1164ac3a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1340 microversion: 2.20 time: 0.240433 Oct 01 04:18:28.834203 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 33/75] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:28 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1340 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:18:28.845956 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5cdc4f66-a2ec-4586-ab2f-856fb19baae5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:28.849298 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5cdc4f66-a2ec-4586-ab2f-856fb19baae5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:28.865191 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5cdc4f66-a2ec-4586-ab2f-856fb19baae5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:28.867568 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5cdc4f66-a2ec-4586-ab2f-856fb19baae5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:28.868423 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5cdc4f66-a2ec-4586-ab2f-856fb19baae5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:28.870869 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5cdc4f66-a2ec-4586-ab2f-856fb19baae5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:28.873113 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5cdc4f66-a2ec-4586-ab2f-856fb19baae5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:28.874434 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5cdc4f66-a2ec-4586-ab2f-856fb19baae5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:29.180644 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-5cdc4f66-a2ec-4586-ab2f-856fb19baae5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:29.200005 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5cdc4f66-a2ec-4586-ab2f-856fb19baae5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1274 microversion: 2.1 time: 0.363365 Oct 01 04:18:29.202181 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 34/76] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:28 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1274 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:29.369016 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-5296992b-f08b-4113-b3a4-4de0c94f4647 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:29.406750 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5296992b-f08b-4113-b3a4-4de0c94f4647 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1363 microversion: 2.1 time: 0.705492 Oct 01 04:18:29.410178 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 43/77] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:28 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1363 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:29.725267 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7a1aa336-a0b9-413b-99ff-85cff0199b55 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:29.726184 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7a1aa336-a0b9-413b-99ff-85cff0199b55 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:29.739680 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a1aa336-a0b9-413b-99ff-85cff0199b55 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:29.741917 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a1aa336-a0b9-413b-99ff-85cff0199b55 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:29.742834 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a1aa336-a0b9-413b-99ff-85cff0199b55 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:29.744426 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a1aa336-a0b9-413b-99ff-85cff0199b55 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:29.744904 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a1aa336-a0b9-413b-99ff-85cff0199b55 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:29.745359 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a1aa336-a0b9-413b-99ff-85cff0199b55 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:29.861192 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-04b86142-5f4c-4684-8e36-c299264d36b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:29.862155 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-04b86142-5f4c-4684-8e36-c299264d36b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:29.877379 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-04b86142-5f4c-4684-8e36-c299264d36b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:29.881073 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-04b86142-5f4c-4684-8e36-c299264d36b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:29.884020 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-04b86142-5f4c-4684-8e36-c299264d36b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:29.887455 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-04b86142-5f4c-4684-8e36-c299264d36b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:29.888043 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-04b86142-5f4c-4684-8e36-c299264d36b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:29.890136 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-04b86142-5f4c-4684-8e36-c299264d36b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:30.149574 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-04b86142-5f4c-4684-8e36-c299264d36b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:30.160050 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-04b86142-5f4c-4684-8e36-c299264d36b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:30.173083 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-04b86142-5f4c-4684-8e36-c299264d36b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:30.174173 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-04b86142-5f4c-4684-8e36-c299264d36b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1340 microversion: 2.20 time: 0.318297 Oct 01 04:18:30.179201 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 44/78] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:29 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1340 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:18:30.224450 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6d41563d-3c97-4c5b-90d0-4b45f90f2694 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:30.225359 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6d41563d-3c97-4c5b-90d0-4b45f90f2694 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:30.233314 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d41563d-3c97-4c5b-90d0-4b45f90f2694 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:30.234146 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d41563d-3c97-4c5b-90d0-4b45f90f2694 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:30.234848 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d41563d-3c97-4c5b-90d0-4b45f90f2694 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:30.235571 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d41563d-3c97-4c5b-90d0-4b45f90f2694 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:30.236034 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d41563d-3c97-4c5b-90d0-4b45f90f2694 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:30.238698 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6d41563d-3c97-4c5b-90d0-4b45f90f2694 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:30.257592 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-7a1aa336-a0b9-413b-99ff-85cff0199b55 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:30.272274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7a1aa336-a0b9-413b-99ff-85cff0199b55 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1315 microversion: 2.1 time: 0.551994 Oct 01 04:18:30.273437 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 35/79] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:29 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1315 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:30.363483 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-6d41563d-3c97-4c5b-90d0-4b45f90f2694 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:30.371770 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6d41563d-3c97-4c5b-90d0-4b45f90f2694 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1280 microversion: 2.1 time: 0.151110 Oct 01 04:18:30.372693 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 45/80] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:30 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1280 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:30.432656 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7e9f312a-b6ab-422c-a474-7365ef4acbeb tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:30.433694 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7e9f312a-b6ab-422c-a474-7365ef4acbeb tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:30.442434 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e9f312a-b6ab-422c-a474-7365ef4acbeb tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:30.443205 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e9f312a-b6ab-422c-a474-7365ef4acbeb tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:30.443907 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e9f312a-b6ab-422c-a474-7365ef4acbeb tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:30.444821 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e9f312a-b6ab-422c-a474-7365ef4acbeb tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:30.446238 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e9f312a-b6ab-422c-a474-7365ef4acbeb tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:30.447082 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7e9f312a-b6ab-422c-a474-7365ef4acbeb tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:30.620813 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-7e9f312a-b6ab-422c-a474-7365ef4acbeb tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:30.631116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7e9f312a-b6ab-422c-a474-7365ef4acbeb tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1363 microversion: 2.1 time: 0.203012 Oct 01 04:18:30.631913 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 36/81] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:30 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:30.820003 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-cab2f2c3-ed4c-4ac3-81ef-097af871649b req-087ec8c0-db38-4c65-ae57-d2209259f0a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2643a3f-906d-4cb4-8b4f-f2a63557ab69", "tag": "ada360f6-273f-42d3-babd-7015209fbaac"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:18:30.834899 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-cab2f2c3-ed4c-4ac3-81ef-097af871649b req-087ec8c0-db38-4c65-ae57-d2209259f0a2 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:30.836430 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-cab2f2c3-ed4c-4ac3-81ef-097af871649b req-087ec8c0-db38-4c65-ae57-d2209259f0a2 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:30.837372 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-cab2f2c3-ed4c-4ac3-81ef-097af871649b req-087ec8c0-db38-4c65-ae57-d2209259f0a2 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:30.853821 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-cab2f2c3-ed4c-4ac3-81ef-097af871649b req-087ec8c0-db38-4c65-ae57-d2209259f0a2 service nova] Creating event network-changed:ada360f6-273f-42d3-babd-7015209fbaac for instance c2643a3f-906d-4cb4-8b4f-f2a63557ab69 on hv-cinder-86004 Oct 01 04:18:30.860201 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-cab2f2c3-ed4c-4ac3-81ef-097af871649b req-087ec8c0-db38-4c65-ae57-d2209259f0a2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050822 Oct 01 04:18:30.861403 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 46/82] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:18:31.216915 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ad3a5e34-249e-4a05-b231-e79db6848886 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:31.218593 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ad3a5e34-249e-4a05-b231-e79db6848886 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:31.230355 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad3a5e34-249e-4a05-b231-e79db6848886 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:31.234406 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad3a5e34-249e-4a05-b231-e79db6848886 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:31.235470 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad3a5e34-249e-4a05-b231-e79db6848886 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:31.258546 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad3a5e34-249e-4a05-b231-e79db6848886 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:31.259922 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad3a5e34-249e-4a05-b231-e79db6848886 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:31.261690 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ad3a5e34-249e-4a05-b231-e79db6848886 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:31.334687 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-c4ee7f0b-08b6-48d8-8571-a5c727ce6211 req-78a80b25-9d4f-41b8-9a92-3f8a2ac3b75f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dfb3a74-410c-431c-bbc1-4f8f6489b924", "name": "network-vif-plugged", "status": "completed", "tag": "03e60013-3f85-4d23-979a-41de21fce50c"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:18:31.357691 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c4ee7f0b-08b6-48d8-8571-a5c727ce6211 req-78a80b25-9d4f-41b8-9a92-3f8a2ac3b75f service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:31.358241 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c4ee7f0b-08b6-48d8-8571-a5c727ce6211 req-78a80b25-9d4f-41b8-9a92-3f8a2ac3b75f service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:31.359524 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c4ee7f0b-08b6-48d8-8571-a5c727ce6211 req-78a80b25-9d4f-41b8-9a92-3f8a2ac3b75f service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:31.375140 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-c4ee7f0b-08b6-48d8-8571-a5c727ce6211 req-78a80b25-9d4f-41b8-9a92-3f8a2ac3b75f service nova] Creating event network-vif-plugged:03e60013-3f85-4d23-979a-41de21fce50c for instance 7dfb3a74-410c-431c-bbc1-4f8f6489b924 on hv-cinder-86004 Oct 01 04:18:31.382204 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-c4ee7f0b-08b6-48d8-8571-a5c727ce6211 req-78a80b25-9d4f-41b8-9a92-3f8a2ac3b75f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142962 Oct 01 04:18:31.383864 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 47/83] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:18:31.394543 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-df5593c5-6ff9-4525-80d3-100950f4207f tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:31.395710 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-df5593c5-6ff9-4525-80d3-100950f4207f tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:31.403305 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df5593c5-6ff9-4525-80d3-100950f4207f tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:31.404076 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df5593c5-6ff9-4525-80d3-100950f4207f tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:31.405858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df5593c5-6ff9-4525-80d3-100950f4207f tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:31.406858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df5593c5-6ff9-4525-80d3-100950f4207f tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:31.408226 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df5593c5-6ff9-4525-80d3-100950f4207f tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:31.408870 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-df5593c5-6ff9-4525-80d3-100950f4207f tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:31.447346 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-ad3a5e34-249e-4a05-b231-e79db6848886 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:31.456978 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-ad3a5e34-249e-4a05-b231-e79db6848886 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:31.461123 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-ad3a5e34-249e-4a05-b231-e79db6848886 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:31.462656 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ad3a5e34-249e-4a05-b231-e79db6848886 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1340 microversion: 2.20 time: 0.251903 Oct 01 04:18:31.478780 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 37/84] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:31 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1340 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:18:31.496744 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-305403dd-03b8-486a-9c44-f8399ae50f03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:31.500636 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-305403dd-03b8-486a-9c44-f8399ae50f03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:31.535069 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-305403dd-03b8-486a-9c44-f8399ae50f03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:31.538306 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-305403dd-03b8-486a-9c44-f8399ae50f03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:31.540417 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-305403dd-03b8-486a-9c44-f8399ae50f03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:31.545144 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-305403dd-03b8-486a-9c44-f8399ae50f03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:31.547100 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-305403dd-03b8-486a-9c44-f8399ae50f03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:31.547750 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-305403dd-03b8-486a-9c44-f8399ae50f03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:32.139410 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-305403dd-03b8-486a-9c44-f8399ae50f03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:32.151680 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-305403dd-03b8-486a-9c44-f8399ae50f03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1322 microversion: 2.1 time: 0.661730 Oct 01 04:18:32.152067 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 38/85] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:31 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1322 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:32.206420 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-526bc2f6-66a1-423c-be2c-a17ef8a15ca6 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:32.207226 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-526bc2f6-66a1-423c-be2c-a17ef8a15ca6 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:32.222224 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-526bc2f6-66a1-423c-be2c-a17ef8a15ca6 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:32.224531 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-526bc2f6-66a1-423c-be2c-a17ef8a15ca6 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:32.225072 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-526bc2f6-66a1-423c-be2c-a17ef8a15ca6 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:32.227140 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-526bc2f6-66a1-423c-be2c-a17ef8a15ca6 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:32.228837 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-526bc2f6-66a1-423c-be2c-a17ef8a15ca6 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:32.232583 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-526bc2f6-66a1-423c-be2c-a17ef8a15ca6 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:32.299249 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-df5593c5-6ff9-4525-80d3-100950f4207f tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:32.322165 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-df5593c5-6ff9-4525-80d3-100950f4207f tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1315 microversion: 2.1 time: 0.936558 Oct 01 04:18:32.322927 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 48/86] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:31 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1315 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:32.494910 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-30571643-1fd8-4394-b375-031423a13ca6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:32.495527 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-30571643-1fd8-4394-b375-031423a13ca6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:32.506819 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-526bc2f6-66a1-423c-be2c-a17ef8a15ca6 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:32.519060 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30571643-1fd8-4394-b375-031423a13ca6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:32.519637 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30571643-1fd8-4394-b375-031423a13ca6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:32.520103 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30571643-1fd8-4394-b375-031423a13ca6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:32.520856 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30571643-1fd8-4394-b375-031423a13ca6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:32.521351 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30571643-1fd8-4394-b375-031423a13ca6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:32.521793 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-30571643-1fd8-4394-b375-031423a13ca6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:32.530944 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-526bc2f6-66a1-423c-be2c-a17ef8a15ca6 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1363 microversion: 2.1 time: 0.370060 Oct 01 04:18:32.533679 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 39/87] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:32 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1363 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:32.721672 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-30571643-1fd8-4394-b375-031423a13ca6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:32.730457 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-30571643-1fd8-4394-b375-031423a13ca6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:32.732144 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-30571643-1fd8-4394-b375-031423a13ca6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:32.733916 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-30571643-1fd8-4394-b375-031423a13ca6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1408 microversion: 2.20 time: 0.242495 Oct 01 04:18:32.747507 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 49/88] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:32 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1408 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:18:33.005655 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-29cfbb90-bd0e-471b-8348-cb1af5cfbad2 req-638fa02d-0d43-4470-8348-f2214f985ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2906cc69-afd9-45dd-b846-38782722ed9a", "tag": "b4f9d636-f677-4f56-ac04-28e98716fbda"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:18:33.038651 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-29cfbb90-bd0e-471b-8348-cb1af5cfbad2 req-638fa02d-0d43-4470-8348-f2214f985ef9 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:33.044247 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-29cfbb90-bd0e-471b-8348-cb1af5cfbad2 req-638fa02d-0d43-4470-8348-f2214f985ef9 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:33.045587 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-29cfbb90-bd0e-471b-8348-cb1af5cfbad2 req-638fa02d-0d43-4470-8348-f2214f985ef9 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:33.096461 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-29cfbb90-bd0e-471b-8348-cb1af5cfbad2 req-638fa02d-0d43-4470-8348-f2214f985ef9 service nova] Creating event network-changed:b4f9d636-f677-4f56-ac04-28e98716fbda for instance 2906cc69-afd9-45dd-b846-38782722ed9a on hv-cinder-86004 Oct 01 04:18:33.097774 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-29cfbb90-bd0e-471b-8348-cb1af5cfbad2 req-638fa02d-0d43-4470-8348-f2214f985ef9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120597) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 01 04:18:33.098314 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-29cfbb90-bd0e-471b-8348-cb1af5cfbad2 req-638fa02d-0d43-4470-8348-f2214f985ef9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120597) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 01 04:18:33.102999 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a54d3574-17f2-454b-8cf8-443688b97718 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:33.106824 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a54d3574-17f2-454b-8cf8-443688b97718 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:33.107759 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a54d3574-17f2-454b-8cf8-443688b97718 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:33.108245 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a54d3574-17f2-454b-8cf8-443688b97718 None None] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:33.113551 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a54d3574-17f2-454b-8cf8-443688b97718 None None] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:33.114700 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a54d3574-17f2-454b-8cf8-443688b97718 None None] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:33.139358 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.compute.rpcapi [None req-a54d3574-17f2-454b-8cf8-443688b97718 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 01 04:18:33.140835 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a54d3574-17f2-454b-8cf8-443688b97718 None None] Releasing lock "compute-rpcapi-router" {{(pid=120597) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 01 04:18:33.159224 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a54d3574-17f2-454b-8cf8-443688b97718 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158671 Oct 01 04:18:33.165309 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 40/89] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:18:33.190673 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d941268f-66da-4945-9a3c-ebaa88d0f0c5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:33.191746 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d941268f-66da-4945-9a3c-ebaa88d0f0c5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:33.222935 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d941268f-66da-4945-9a3c-ebaa88d0f0c5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:33.223425 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d941268f-66da-4945-9a3c-ebaa88d0f0c5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:33.223857 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d941268f-66da-4945-9a3c-ebaa88d0f0c5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:33.224563 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d941268f-66da-4945-9a3c-ebaa88d0f0c5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:33.238814 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d941268f-66da-4945-9a3c-ebaa88d0f0c5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:33.240756 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d941268f-66da-4945-9a3c-ebaa88d0f0c5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:33.366478 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9ab53370-386b-4f15-af71-803f04d2ac84 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:33.369477 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9ab53370-386b-4f15-af71-803f04d2ac84 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:33.393939 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ab53370-386b-4f15-af71-803f04d2ac84 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:33.394440 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ab53370-386b-4f15-af71-803f04d2ac84 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:33.394884 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ab53370-386b-4f15-af71-803f04d2ac84 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:33.398276 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ab53370-386b-4f15-af71-803f04d2ac84 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:33.399181 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ab53370-386b-4f15-af71-803f04d2ac84 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:33.399625 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9ab53370-386b-4f15-af71-803f04d2ac84 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:33.466872 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d941268f-66da-4945-9a3c-ebaa88d0f0c5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:33.486335 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d941268f-66da-4945-9a3c-ebaa88d0f0c5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1322 microversion: 2.1 time: 0.303271 Oct 01 04:18:33.486335 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 50/90] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:33 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1322 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:33.555577 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2253eee2-3b3e-4dee-8785-e7823f3054dc tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:33.556192 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2253eee2-3b3e-4dee-8785-e7823f3054dc tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:33.563219 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2253eee2-3b3e-4dee-8785-e7823f3054dc tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:33.563640 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2253eee2-3b3e-4dee-8785-e7823f3054dc tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:33.564079 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2253eee2-3b3e-4dee-8785-e7823f3054dc tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:33.564776 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2253eee2-3b3e-4dee-8785-e7823f3054dc tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:33.570378 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2253eee2-3b3e-4dee-8785-e7823f3054dc tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:33.571270 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2253eee2-3b3e-4dee-8785-e7823f3054dc tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:33.747613 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-9ab53370-386b-4f15-af71-803f04d2ac84 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:33.772035 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9ab53370-386b-4f15-af71-803f04d2ac84 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1315 microversion: 2.1 time: 0.417140 Oct 01 04:18:33.772826 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 41/91] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:33 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:33.795570 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1477a178-67f9-43cb-8581-3a23c1575221 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:33.797820 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1477a178-67f9-43cb-8581-3a23c1575221 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:33.811149 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1477a178-67f9-43cb-8581-3a23c1575221 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:33.812631 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1477a178-67f9-43cb-8581-3a23c1575221 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:33.813513 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1477a178-67f9-43cb-8581-3a23c1575221 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:33.814418 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1477a178-67f9-43cb-8581-3a23c1575221 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:33.815431 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1477a178-67f9-43cb-8581-3a23c1575221 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:33.816061 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1477a178-67f9-43cb-8581-3a23c1575221 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:33.883135 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2253eee2-3b3e-4dee-8785-e7823f3054dc tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:33.887056 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:33.895863 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2253eee2-3b3e-4dee-8785-e7823f3054dc tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1363 microversion: 2.1 time: 0.343678 Oct 01 04:18:33.898710 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 51/92] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:33 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1363 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:18:34.100216 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-1477a178-67f9-43cb-8581-3a23c1575221 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:34.112756 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:34.126888 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-1477a178-67f9-43cb-8581-3a23c1575221 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:34.130067 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-1477a178-67f9-43cb-8581-3a23c1575221 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:34.131077 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1477a178-67f9-43cb-8581-3a23c1575221 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1408 microversion: 2.20 time: 0.347258 Oct 01 04:18:34.131840 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 42/93] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:33 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1408 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:18:34.516609 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ee22b7a9-fc6a-41bb-91f8-83fe98e4a03b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:34.517694 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ee22b7a9-fc6a-41bb-91f8-83fe98e4a03b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:34.527837 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee22b7a9-fc6a-41bb-91f8-83fe98e4a03b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:34.528680 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee22b7a9-fc6a-41bb-91f8-83fe98e4a03b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:34.529892 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee22b7a9-fc6a-41bb-91f8-83fe98e4a03b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:34.532004 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee22b7a9-fc6a-41bb-91f8-83fe98e4a03b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:34.533093 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee22b7a9-fc6a-41bb-91f8-83fe98e4a03b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:34.534012 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ee22b7a9-fc6a-41bb-91f8-83fe98e4a03b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:34.743688 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ee22b7a9-fc6a-41bb-91f8-83fe98e4a03b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:34.756098 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ee22b7a9-fc6a-41bb-91f8-83fe98e4a03b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1322 microversion: 2.1 time: 0.248269 Oct 01 04:18:34.769792 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 52/94] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:34 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:34.799613 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-82d977c0-896a-48fd-89e2-19bdb2ec7314 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:34.800800 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-82d977c0-896a-48fd-89e2-19bdb2ec7314 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:34.806995 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82d977c0-896a-48fd-89e2-19bdb2ec7314 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:34.807485 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82d977c0-896a-48fd-89e2-19bdb2ec7314 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:34.808497 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82d977c0-896a-48fd-89e2-19bdb2ec7314 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:34.809244 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82d977c0-896a-48fd-89e2-19bdb2ec7314 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:34.809712 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82d977c0-896a-48fd-89e2-19bdb2ec7314 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:34.810200 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82d977c0-896a-48fd-89e2-19bdb2ec7314 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:34.927153 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f5cb67ac-30ea-4c3f-8497-524ad01057cd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:34.927787 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f5cb67ac-30ea-4c3f-8497-524ad01057cd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:34.944827 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5cb67ac-30ea-4c3f-8497-524ad01057cd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:34.947415 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5cb67ac-30ea-4c3f-8497-524ad01057cd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:34.947878 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5cb67ac-30ea-4c3f-8497-524ad01057cd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:34.949022 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5cb67ac-30ea-4c3f-8497-524ad01057cd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:34.950057 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5cb67ac-30ea-4c3f-8497-524ad01057cd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:34.950684 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5cb67ac-30ea-4c3f-8497-524ad01057cd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:35.085835 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-82d977c0-896a-48fd-89e2-19bdb2ec7314 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:35.095705 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-82d977c0-896a-48fd-89e2-19bdb2ec7314 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1315 microversion: 2.1 time: 0.301188 Oct 01 04:18:35.113607 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 43/95] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:34 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:35.157717 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5bba312e-56b0-4dfb-8a59-1fcbfc0dcfeb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:35.158472 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5bba312e-56b0-4dfb-8a59-1fcbfc0dcfeb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:35.164541 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bba312e-56b0-4dfb-8a59-1fcbfc0dcfeb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:35.165925 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bba312e-56b0-4dfb-8a59-1fcbfc0dcfeb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:35.166823 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bba312e-56b0-4dfb-8a59-1fcbfc0dcfeb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:35.167817 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bba312e-56b0-4dfb-8a59-1fcbfc0dcfeb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:35.168443 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bba312e-56b0-4dfb-8a59-1fcbfc0dcfeb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:35.168981 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5bba312e-56b0-4dfb-8a59-1fcbfc0dcfeb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:35.207710 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f5cb67ac-30ea-4c3f-8497-524ad01057cd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:35.229713 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f5cb67ac-30ea-4c3f-8497-524ad01057cd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1363 microversion: 2.1 time: 0.311446 Oct 01 04:18:35.230300 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 53/96] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:34 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1363 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:35.357958 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-5bba312e-56b0-4dfb-8a59-1fcbfc0dcfeb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:35.367735 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-5bba312e-56b0-4dfb-8a59-1fcbfc0dcfeb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:35.369329 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-5bba312e-56b0-4dfb-8a59-1fcbfc0dcfeb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:35.370964 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5bba312e-56b0-4dfb-8a59-1fcbfc0dcfeb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1408 microversion: 2.20 time: 0.217301 Oct 01 04:18:35.371604 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 44/97] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:35 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:18:35.474328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-6e9ae35d-7554-4c9f-b596-ca77c064d225 req-32872fd0-6e00-4e53-9168-9c74e6ffff55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e14e3570-67e7-43d6-bcaf-6688168956b2", "tag": "28ed6420-e14b-48a2-a448-a8ab736b93af"}, {"name": "network-changed", "server_uuid": "f161c249-ba0f-42c9-a1f0-8c7913b666f9", "tag": "94c6e2ab-bf5f-4d4a-87aa-757bce04cc43"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:18:35.484919 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6e9ae35d-7554-4c9f-b596-ca77c064d225 req-32872fd0-6e00-4e53-9168-9c74e6ffff55 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:35.485428 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6e9ae35d-7554-4c9f-b596-ca77c064d225 req-32872fd0-6e00-4e53-9168-9c74e6ffff55 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:35.485859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6e9ae35d-7554-4c9f-b596-ca77c064d225 req-32872fd0-6e00-4e53-9168-9c74e6ffff55 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:35.498698 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-6e9ae35d-7554-4c9f-b596-ca77c064d225 req-32872fd0-6e00-4e53-9168-9c74e6ffff55 service nova] Creating event network-changed:28ed6420-e14b-48a2-a448-a8ab736b93af for instance e14e3570-67e7-43d6-bcaf-6688168956b2 on hv-cinder-86004 Oct 01 04:18:35.499770 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-6e9ae35d-7554-4c9f-b596-ca77c064d225 req-32872fd0-6e00-4e53-9168-9c74e6ffff55 service nova] Creating event network-changed:94c6e2ab-bf5f-4d4a-87aa-757bce04cc43 for instance f161c249-ba0f-42c9-a1f0-8c7913b666f9 on hv-cinder-86004 Oct 01 04:18:35.505995 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-6e9ae35d-7554-4c9f-b596-ca77c064d225 req-32872fd0-6e00-4e53-9168-9c74e6ffff55 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035230 Oct 01 04:18:35.506740 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 54/98] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:18:35.781241 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b0fd78fb-9c68-49b7-b185-f4cfd0a76bb5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:35.781855 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b0fd78fb-9c68-49b7-b185-f4cfd0a76bb5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:35.787936 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0fd78fb-9c68-49b7-b185-f4cfd0a76bb5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:35.788505 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0fd78fb-9c68-49b7-b185-f4cfd0a76bb5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:35.788971 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0fd78fb-9c68-49b7-b185-f4cfd0a76bb5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:35.789818 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0fd78fb-9c68-49b7-b185-f4cfd0a76bb5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:35.790277 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0fd78fb-9c68-49b7-b185-f4cfd0a76bb5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:35.790703 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b0fd78fb-9c68-49b7-b185-f4cfd0a76bb5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:35.925072 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-b0fd78fb-9c68-49b7-b185-f4cfd0a76bb5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:35.934142 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b0fd78fb-9c68-49b7-b185-f4cfd0a76bb5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1322 microversion: 2.1 time: 0.156825 Oct 01 04:18:35.935275 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 45/99] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:35 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:36.123273 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5ce48db6-d98f-478d-9450-e422548830e9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:36.124507 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5ce48db6-d98f-478d-9450-e422548830e9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:36.130838 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ce48db6-d98f-478d-9450-e422548830e9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:36.131516 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ce48db6-d98f-478d-9450-e422548830e9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:36.132008 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ce48db6-d98f-478d-9450-e422548830e9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:36.133456 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ce48db6-d98f-478d-9450-e422548830e9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:36.133930 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ce48db6-d98f-478d-9450-e422548830e9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:36.134365 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ce48db6-d98f-478d-9450-e422548830e9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:36.255571 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-75a587e6-6371-4267-acba-e22923863d02 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:36.256324 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-75a587e6-6371-4267-acba-e22923863d02 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:36.262435 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-75a587e6-6371-4267-acba-e22923863d02 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:36.262996 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-75a587e6-6371-4267-acba-e22923863d02 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:36.263495 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-75a587e6-6371-4267-acba-e22923863d02 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:36.264248 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-75a587e6-6371-4267-acba-e22923863d02 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:36.265331 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-75a587e6-6371-4267-acba-e22923863d02 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:36.266005 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-75a587e6-6371-4267-acba-e22923863d02 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:36.282522 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-5ce48db6-d98f-478d-9450-e422548830e9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:36.290715 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5ce48db6-d98f-478d-9450-e422548830e9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1315 microversion: 2.1 time: 0.171742 Oct 01 04:18:36.291630 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 55/100] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:36 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:36.398605 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-15153f6c-2088-4375-a59f-3e609dcb667c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:36.399248 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-15153f6c-2088-4375-a59f-3e609dcb667c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:36.406512 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15153f6c-2088-4375-a59f-3e609dcb667c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:36.407005 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15153f6c-2088-4375-a59f-3e609dcb667c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:36.407446 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15153f6c-2088-4375-a59f-3e609dcb667c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:36.408328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15153f6c-2088-4375-a59f-3e609dcb667c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:36.408792 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15153f6c-2088-4375-a59f-3e609dcb667c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:36.409246 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15153f6c-2088-4375-a59f-3e609dcb667c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:36.414911 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-75a587e6-6371-4267-acba-e22923863d02 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:36.424293 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-75a587e6-6371-4267-acba-e22923863d02 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1363 microversion: 2.1 time: 0.173620 Oct 01 04:18:36.424866 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 46/101] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:36 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:18:36.557516 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-15153f6c-2088-4375-a59f-3e609dcb667c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:36.564156 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-15153f6c-2088-4375-a59f-3e609dcb667c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:36.565639 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-15153f6c-2088-4375-a59f-3e609dcb667c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:36.566750 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-15153f6c-2088-4375-a59f-3e609dcb667c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1408 microversion: 2.20 time: 0.172383 Oct 01 04:18:36.567305 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 56/102] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:36 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1408 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:18:36.964244 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-31e5f8ed-b63e-45c4-af50-db139b9e6a39 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:36.964886 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-31e5f8ed-b63e-45c4-af50-db139b9e6a39 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:36.974339 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31e5f8ed-b63e-45c4-af50-db139b9e6a39 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:36.974881 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31e5f8ed-b63e-45c4-af50-db139b9e6a39 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:36.975316 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31e5f8ed-b63e-45c4-af50-db139b9e6a39 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:36.976471 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31e5f8ed-b63e-45c4-af50-db139b9e6a39 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:36.977152 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31e5f8ed-b63e-45c4-af50-db139b9e6a39 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:36.979374 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31e5f8ed-b63e-45c4-af50-db139b9e6a39 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:37.177959 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-31e5f8ed-b63e-45c4-af50-db139b9e6a39 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:37.186167 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-31e5f8ed-b63e-45c4-af50-db139b9e6a39 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1322 microversion: 2.1 time: 0.227242 Oct 01 04:18:37.203234 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 47/103] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:36 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:37.314276 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a7a3a73e-5525-4686-bbf2-2c69ad6c7b10 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:37.315040 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a7a3a73e-5525-4686-bbf2-2c69ad6c7b10 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:37.321840 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7a3a73e-5525-4686-bbf2-2c69ad6c7b10 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:37.322365 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7a3a73e-5525-4686-bbf2-2c69ad6c7b10 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:37.322780 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7a3a73e-5525-4686-bbf2-2c69ad6c7b10 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:37.323487 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7a3a73e-5525-4686-bbf2-2c69ad6c7b10 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:37.324120 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7a3a73e-5525-4686-bbf2-2c69ad6c7b10 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:37.324956 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a7a3a73e-5525-4686-bbf2-2c69ad6c7b10 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:37.449969 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f717e8c4-483a-4c4f-a9f7-9b88f8161767 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:37.451100 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f717e8c4-483a-4c4f-a9f7-9b88f8161767 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:37.464710 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f717e8c4-483a-4c4f-a9f7-9b88f8161767 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:37.466088 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f717e8c4-483a-4c4f-a9f7-9b88f8161767 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:37.466743 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f717e8c4-483a-4c4f-a9f7-9b88f8161767 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:37.470392 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f717e8c4-483a-4c4f-a9f7-9b88f8161767 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:37.472485 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f717e8c4-483a-4c4f-a9f7-9b88f8161767 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:37.473476 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f717e8c4-483a-4c4f-a9f7-9b88f8161767 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:37.588259 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a7a3a73e-5525-4686-bbf2-2c69ad6c7b10 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:37.597239 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a7a3a73e-5525-4686-bbf2-2c69ad6c7b10 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1315 microversion: 2.1 time: 0.286805 Oct 01 04:18:37.601323 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 57/104] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:37 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:37.606288 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-88c768f8-b3b4-4262-8052-11908f3cd203 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:37.606933 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-88c768f8-b3b4-4262-8052-11908f3cd203 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:37.618587 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88c768f8-b3b4-4262-8052-11908f3cd203 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:37.619499 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88c768f8-b3b4-4262-8052-11908f3cd203 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:37.620063 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88c768f8-b3b4-4262-8052-11908f3cd203 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:37.621205 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88c768f8-b3b4-4262-8052-11908f3cd203 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:37.621878 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88c768f8-b3b4-4262-8052-11908f3cd203 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:37.622640 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88c768f8-b3b4-4262-8052-11908f3cd203 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:37.766215 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-f717e8c4-483a-4c4f-a9f7-9b88f8161767 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:37.775215 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f717e8c4-483a-4c4f-a9f7-9b88f8161767 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1363 microversion: 2.1 time: 0.330054 Oct 01 04:18:37.776139 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 48/105] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:37 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1363 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:18:37.813777 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-88c768f8-b3b4-4262-8052-11908f3cd203 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:37.822057 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-88c768f8-b3b4-4262-8052-11908f3cd203 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:37.823614 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-88c768f8-b3b4-4262-8052-11908f3cd203 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:37.824801 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-88c768f8-b3b4-4262-8052-11908f3cd203 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1408 microversion: 2.20 time: 0.222293 Oct 01 04:18:37.825557 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 58/106] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:37 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:18:38.213292 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-040c470f-fcc3-4168-8f74-94e241eead39 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:38.214064 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-040c470f-fcc3-4168-8f74-94e241eead39 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:38.221275 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-040c470f-fcc3-4168-8f74-94e241eead39 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:38.221998 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-040c470f-fcc3-4168-8f74-94e241eead39 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:38.222695 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-040c470f-fcc3-4168-8f74-94e241eead39 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:38.223962 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-040c470f-fcc3-4168-8f74-94e241eead39 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:38.224496 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-040c470f-fcc3-4168-8f74-94e241eead39 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:38.225717 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-040c470f-fcc3-4168-8f74-94e241eead39 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:38.362952 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-040c470f-fcc3-4168-8f74-94e241eead39 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:38.370515 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-040c470f-fcc3-4168-8f74-94e241eead39 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1322 microversion: 2.1 time: 0.161037 Oct 01 04:18:38.371015 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 49/107] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:38 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:38.620513 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d86bfc84-f207-4cd7-b2b3-da33fc374a87 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:38.621218 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d86bfc84-f207-4cd7-b2b3-da33fc374a87 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:38.627244 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d86bfc84-f207-4cd7-b2b3-da33fc374a87 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:38.627735 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d86bfc84-f207-4cd7-b2b3-da33fc374a87 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:38.628174 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d86bfc84-f207-4cd7-b2b3-da33fc374a87 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:38.628864 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d86bfc84-f207-4cd7-b2b3-da33fc374a87 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:38.629347 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d86bfc84-f207-4cd7-b2b3-da33fc374a87 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:38.629775 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d86bfc84-f207-4cd7-b2b3-da33fc374a87 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:38.765588 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d86bfc84-f207-4cd7-b2b3-da33fc374a87 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:38.772949 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d86bfc84-f207-4cd7-b2b3-da33fc374a87 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1315 microversion: 2.1 time: 0.156224 Oct 01 04:18:38.773538 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 59/108] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:38 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:38.800898 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6b86a385-aed4-49e3-8164-76e46c7c4934 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:38.801533 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6b86a385-aed4-49e3-8164-76e46c7c4934 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:38.808217 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b86a385-aed4-49e3-8164-76e46c7c4934 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:38.808709 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b86a385-aed4-49e3-8164-76e46c7c4934 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:38.809179 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b86a385-aed4-49e3-8164-76e46c7c4934 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:38.809882 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b86a385-aed4-49e3-8164-76e46c7c4934 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:38.810343 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b86a385-aed4-49e3-8164-76e46c7c4934 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:38.810770 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b86a385-aed4-49e3-8164-76e46c7c4934 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:38.850855 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-67177efb-4db7-4c6f-8832-a7f274452a45 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:38.851450 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-67177efb-4db7-4c6f-8832-a7f274452a45 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:38.857443 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67177efb-4db7-4c6f-8832-a7f274452a45 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:38.857927 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67177efb-4db7-4c6f-8832-a7f274452a45 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:38.859019 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67177efb-4db7-4c6f-8832-a7f274452a45 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:38.859954 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67177efb-4db7-4c6f-8832-a7f274452a45 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:38.860413 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67177efb-4db7-4c6f-8832-a7f274452a45 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:38.860837 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67177efb-4db7-4c6f-8832-a7f274452a45 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:38.997553 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-6b86a385-aed4-49e3-8164-76e46c7c4934 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:39.019254 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6b86a385-aed4-49e3-8164-76e46c7c4934 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1363 microversion: 2.1 time: 0.222115 Oct 01 04:18:39.019854 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 50/109] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:38 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:39.033270 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-67177efb-4db7-4c6f-8832-a7f274452a45 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:39.041934 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-67177efb-4db7-4c6f-8832-a7f274452a45 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:39.043583 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-67177efb-4db7-4c6f-8832-a7f274452a45 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:39.044771 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-67177efb-4db7-4c6f-8832-a7f274452a45 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1408 microversion: 2.20 time: 0.197744 Oct 01 04:18:39.045647 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 60/110] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:38 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:18:39.394624 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-736e3aa6-6e2f-4418-af97-999b5e9a1925 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:39.395250 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-736e3aa6-6e2f-4418-af97-999b5e9a1925 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:39.401539 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-736e3aa6-6e2f-4418-af97-999b5e9a1925 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:39.402024 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-736e3aa6-6e2f-4418-af97-999b5e9a1925 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:39.402459 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-736e3aa6-6e2f-4418-af97-999b5e9a1925 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:39.403144 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-736e3aa6-6e2f-4418-af97-999b5e9a1925 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:39.403601 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-736e3aa6-6e2f-4418-af97-999b5e9a1925 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:39.404026 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-736e3aa6-6e2f-4418-af97-999b5e9a1925 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:39.527764 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-736e3aa6-6e2f-4418-af97-999b5e9a1925 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:39.536486 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-736e3aa6-6e2f-4418-af97-999b5e9a1925 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1322 microversion: 2.1 time: 0.146086 Oct 01 04:18:39.537065 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 51/111] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:39 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:39.795926 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bd58d7f3-83d1-4a0b-9e7d-a460a8829d24 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:39.796654 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bd58d7f3-83d1-4a0b-9e7d-a460a8829d24 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:39.802965 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd58d7f3-83d1-4a0b-9e7d-a460a8829d24 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:39.803456 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd58d7f3-83d1-4a0b-9e7d-a460a8829d24 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:39.803899 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd58d7f3-83d1-4a0b-9e7d-a460a8829d24 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:39.804596 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd58d7f3-83d1-4a0b-9e7d-a460a8829d24 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:39.805091 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd58d7f3-83d1-4a0b-9e7d-a460a8829d24 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:39.805526 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd58d7f3-83d1-4a0b-9e7d-a460a8829d24 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:39.934490 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-bd58d7f3-83d1-4a0b-9e7d-a460a8829d24 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:39.942505 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bd58d7f3-83d1-4a0b-9e7d-a460a8829d24 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1315 microversion: 2.1 time: 0.150524 Oct 01 04:18:39.943062 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 61/112] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:39 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:40.042613 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-48b5080c-419e-473a-9af5-48db99957b3b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:40.043145 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-48b5080c-419e-473a-9af5-48db99957b3b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:40.050027 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-48b5080c-419e-473a-9af5-48db99957b3b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:40.050517 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-48b5080c-419e-473a-9af5-48db99957b3b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:40.050957 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-48b5080c-419e-473a-9af5-48db99957b3b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:40.051650 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-48b5080c-419e-473a-9af5-48db99957b3b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:40.052113 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-48b5080c-419e-473a-9af5-48db99957b3b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:40.052574 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-48b5080c-419e-473a-9af5-48db99957b3b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:40.070055 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ff34d48b-9f27-4f5b-a452-1d3c42f3e64d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:40.070657 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ff34d48b-9f27-4f5b-a452-1d3c42f3e64d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:40.076425 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff34d48b-9f27-4f5b-a452-1d3c42f3e64d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:40.076933 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff34d48b-9f27-4f5b-a452-1d3c42f3e64d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:40.077399 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff34d48b-9f27-4f5b-a452-1d3c42f3e64d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:40.078071 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff34d48b-9f27-4f5b-a452-1d3c42f3e64d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:40.078521 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff34d48b-9f27-4f5b-a452-1d3c42f3e64d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:40.078942 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff34d48b-9f27-4f5b-a452-1d3c42f3e64d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:40.254161 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-48b5080c-419e-473a-9af5-48db99957b3b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:40.258191 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ff34d48b-9f27-4f5b-a452-1d3c42f3e64d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:40.262069 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-48b5080c-419e-473a-9af5-48db99957b3b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1363 microversion: 2.1 time: 0.223327 Oct 01 04:18:40.262678 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 52/113] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:40 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:40.266406 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ff34d48b-9f27-4f5b-a452-1d3c42f3e64d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:40.267850 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ff34d48b-9f27-4f5b-a452-1d3c42f3e64d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:40.268952 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ff34d48b-9f27-4f5b-a452-1d3c42f3e64d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1408 microversion: 2.20 time: 0.202660 Oct 01 04:18:40.269508 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 62/114] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:40 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1408 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:18:40.558122 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7b7d251e-369b-4784-8021-0c200e3f9452 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:40.558661 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7b7d251e-369b-4784-8021-0c200e3f9452 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:40.564469 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b7d251e-369b-4784-8021-0c200e3f9452 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:40.564981 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b7d251e-369b-4784-8021-0c200e3f9452 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:40.565424 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b7d251e-369b-4784-8021-0c200e3f9452 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:40.566108 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b7d251e-369b-4784-8021-0c200e3f9452 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:40.566572 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b7d251e-369b-4784-8021-0c200e3f9452 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:40.567021 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b7d251e-369b-4784-8021-0c200e3f9452 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:40.698856 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-7b7d251e-369b-4784-8021-0c200e3f9452 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:40.706880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7b7d251e-369b-4784-8021-0c200e3f9452 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1322 microversion: 2.1 time: 0.152672 Oct 01 04:18:40.707475 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 53/115] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:40 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:40.974134 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2c44abe1-1b8f-4953-9c41-eed24d78b153 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:40.975354 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2c44abe1-1b8f-4953-9c41-eed24d78b153 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:40.988470 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c44abe1-1b8f-4953-9c41-eed24d78b153 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:40.989300 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c44abe1-1b8f-4953-9c41-eed24d78b153 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:40.989910 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c44abe1-1b8f-4953-9c41-eed24d78b153 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:40.990832 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c44abe1-1b8f-4953-9c41-eed24d78b153 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:40.991581 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c44abe1-1b8f-4953-9c41-eed24d78b153 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:40.992156 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c44abe1-1b8f-4953-9c41-eed24d78b153 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:41.161427 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2c44abe1-1b8f-4953-9c41-eed24d78b153 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:41.170805 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2c44abe1-1b8f-4953-9c41-eed24d78b153 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1503 microversion: 2.1 time: 0.208408 Oct 01 04:18:41.177888 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 63/116] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:40 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1503 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:41.218268 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-79a4b01f-0692-490b-a4fe-a6ee9aa6b1cc req-bb263538-c4e4-4464-b723-f191db316e0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2643a3f-906d-4cb4-8b4f-f2a63557ab69", "name": "network-vif-plugged", "status": "completed", "tag": "ada360f6-273f-42d3-babd-7015209fbaac"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:18:41.235942 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-79a4b01f-0692-490b-a4fe-a6ee9aa6b1cc req-bb263538-c4e4-4464-b723-f191db316e0e service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:41.236432 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-79a4b01f-0692-490b-a4fe-a6ee9aa6b1cc req-bb263538-c4e4-4464-b723-f191db316e0e service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:41.237659 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-79a4b01f-0692-490b-a4fe-a6ee9aa6b1cc req-bb263538-c4e4-4464-b723-f191db316e0e service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:41.253587 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-79a4b01f-0692-490b-a4fe-a6ee9aa6b1cc req-bb263538-c4e4-4464-b723-f191db316e0e service nova] Creating event network-vif-plugged:ada360f6-273f-42d3-babd-7015209fbaac for instance c2643a3f-906d-4cb4-8b4f-f2a63557ab69 on hv-cinder-86004 Oct 01 04:18:41.260535 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-79a4b01f-0692-490b-a4fe-a6ee9aa6b1cc req-bb263538-c4e4-4464-b723-f191db316e0e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047646 Oct 01 04:18:41.261486 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 54/117] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:18:41.290238 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9f65c4ac-c0ec-4d92-a131-cf2905317374 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:41.291750 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9f65c4ac-c0ec-4d92-a131-cf2905317374 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:41.320736 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f65c4ac-c0ec-4d92-a131-cf2905317374 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:41.321343 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-405639fe-5baf-4933-a6f6-68231a717877 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:41.322338 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-405639fe-5baf-4933-a6f6-68231a717877 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:41.322998 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f65c4ac-c0ec-4d92-a131-cf2905317374 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:41.325596 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f65c4ac-c0ec-4d92-a131-cf2905317374 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:41.326507 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f65c4ac-c0ec-4d92-a131-cf2905317374 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:41.330552 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f65c4ac-c0ec-4d92-a131-cf2905317374 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:41.332566 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-405639fe-5baf-4933-a6f6-68231a717877 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:41.333294 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-405639fe-5baf-4933-a6f6-68231a717877 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:41.333891 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-405639fe-5baf-4933-a6f6-68231a717877 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:41.334381 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f65c4ac-c0ec-4d92-a131-cf2905317374 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:41.335066 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-405639fe-5baf-4933-a6f6-68231a717877 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:41.336481 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-405639fe-5baf-4933-a6f6-68231a717877 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:41.337382 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-405639fe-5baf-4933-a6f6-68231a717877 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:41.604738 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-9f65c4ac-c0ec-4d92-a131-cf2905317374 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:41.610789 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-405639fe-5baf-4933-a6f6-68231a717877 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:41.617305 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9f65c4ac-c0ec-4d92-a131-cf2905317374 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1363 microversion: 2.1 time: 0.334636 Oct 01 04:18:41.617789 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 64/118] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:41 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1363 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:41.623320 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-405639fe-5baf-4933-a6f6-68231a717877 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:41.626462 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-405639fe-5baf-4933-a6f6-68231a717877 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:41.630287 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-405639fe-5baf-4933-a6f6-68231a717877 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1408 microversion: 2.20 time: 0.333614 Oct 01 04:18:41.633415 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 55/119] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:41 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1408 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:18:41.733731 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ae1d6d94-d0d6-4444-b0d5-aa09685d3b96 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:41.734646 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ae1d6d94-d0d6-4444-b0d5-aa09685d3b96 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:41.755315 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae1d6d94-d0d6-4444-b0d5-aa09685d3b96 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:41.757984 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae1d6d94-d0d6-4444-b0d5-aa09685d3b96 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:41.758788 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae1d6d94-d0d6-4444-b0d5-aa09685d3b96 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:41.761177 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae1d6d94-d0d6-4444-b0d5-aa09685d3b96 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:41.761851 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae1d6d94-d0d6-4444-b0d5-aa09685d3b96 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:41.763101 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ae1d6d94-d0d6-4444-b0d5-aa09685d3b96 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:41.981230 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ae1d6d94-d0d6-4444-b0d5-aa09685d3b96 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:41.991005 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ae1d6d94-d0d6-4444-b0d5-aa09685d3b96 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1322 microversion: 2.1 time: 0.263987 Oct 01 04:18:42.000579 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 65/120] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:41 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:42.642978 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f9edeede-ea49-4374-a302-84b7416a07aa tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:42.644276 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f9edeede-ea49-4374-a302-84b7416a07aa tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:42.650650 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9edeede-ea49-4374-a302-84b7416a07aa tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:42.651726 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9edeede-ea49-4374-a302-84b7416a07aa tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:42.652916 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9edeede-ea49-4374-a302-84b7416a07aa tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:42.654014 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9edeede-ea49-4374-a302-84b7416a07aa tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:42.654696 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9edeede-ea49-4374-a302-84b7416a07aa tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:42.656546 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f9edeede-ea49-4374-a302-84b7416a07aa tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:42.659568 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-79fda373-533b-4c1e-9b3e-35289193bfae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:42.660183 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-79fda373-533b-4c1e-9b3e-35289193bfae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:42.667258 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79fda373-533b-4c1e-9b3e-35289193bfae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:42.668031 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79fda373-533b-4c1e-9b3e-35289193bfae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:42.668618 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79fda373-533b-4c1e-9b3e-35289193bfae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:42.669520 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79fda373-533b-4c1e-9b3e-35289193bfae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:42.670126 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79fda373-533b-4c1e-9b3e-35289193bfae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:42.671384 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79fda373-533b-4c1e-9b3e-35289193bfae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:42.899955 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-f9edeede-ea49-4374-a302-84b7416a07aa tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:42.910423 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f9edeede-ea49-4374-a302-84b7416a07aa tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1363 microversion: 2.1 time: 0.272130 Oct 01 04:18:42.914584 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 56/121] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:42 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:42.939260 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5fdc495a-84a5-45d4-8a59-bfd9752779f6 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e2b19a8-f7e3-446f-9f50-628080f4f78e"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:18:42.941832 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5fdc495a-84a5-45d4-8a59-bfd9752779f6 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:42.948653 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5fdc495a-84a5-45d4-8a59-bfd9752779f6 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:42.949304 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5fdc495a-84a5-45d4-8a59-bfd9752779f6 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:42.949936 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5fdc495a-84a5-45d4-8a59-bfd9752779f6 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:42.950876 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5fdc495a-84a5-45d4-8a59-bfd9752779f6 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:42.951468 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5fdc495a-84a5-45d4-8a59-bfd9752779f6 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:42.952976 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5fdc495a-84a5-45d4-8a59-bfd9752779f6 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:42.999847 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-79fda373-533b-4c1e-9b3e-35289193bfae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:43.013631 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-79fda373-533b-4c1e-9b3e-35289193bfae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:43.016363 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-79fda373-533b-4c1e-9b3e-35289193bfae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:43.018897 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-79fda373-533b-4c1e-9b3e-35289193bfae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1408 microversion: 2.20 time: 0.363505 Oct 01 04:18:43.029592 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 66/122] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:42 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1408 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:18:43.043723 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4ce9ee73-875f-4422-84cb-47851f7421fb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:43.044682 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4ce9ee73-875f-4422-84cb-47851f7421fb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:43.051407 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ce9ee73-875f-4422-84cb-47851f7421fb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:43.051894 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ce9ee73-875f-4422-84cb-47851f7421fb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:43.052492 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ce9ee73-875f-4422-84cb-47851f7421fb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:43.053379 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ce9ee73-875f-4422-84cb-47851f7421fb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:43.054069 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ce9ee73-875f-4422-84cb-47851f7421fb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:43.055275 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ce9ee73-875f-4422-84cb-47851f7421fb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:43.137498 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:43.250341 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4ce9ee73-875f-4422-84cb-47851f7421fb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:43.260021 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4ce9ee73-875f-4422-84cb-47851f7421fb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1322 microversion: 2.1 time: 0.228034 Oct 01 04:18:43.273865 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 67/123] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:43 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:43.288021 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-4707fc6e-50c2-40fb-b1d8-89a3ada410a3 req-af8d792d-81de-4a0e-bc6c-fb6efe5a6af7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2906cc69-afd9-45dd-b846-38782722ed9a", "name": "network-vif-plugged", "status": "completed", "tag": "b4f9d636-f677-4f56-ac04-28e98716fbda"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:18:43.299405 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4707fc6e-50c2-40fb-b1d8-89a3ada410a3 req-af8d792d-81de-4a0e-bc6c-fb6efe5a6af7 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:43.299892 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4707fc6e-50c2-40fb-b1d8-89a3ada410a3 req-af8d792d-81de-4a0e-bc6c-fb6efe5a6af7 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:43.300323 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4707fc6e-50c2-40fb-b1d8-89a3ada410a3 req-af8d792d-81de-4a0e-bc6c-fb6efe5a6af7 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:43.313417 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-4707fc6e-50c2-40fb-b1d8-89a3ada410a3 req-af8d792d-81de-4a0e-bc6c-fb6efe5a6af7 service nova] Creating event network-vif-plugged:b4f9d636-f677-4f56-ac04-28e98716fbda for instance 2906cc69-afd9-45dd-b846-38782722ed9a on hv-cinder-86004 Oct 01 04:18:43.320160 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-4707fc6e-50c2-40fb-b1d8-89a3ada410a3 req-af8d792d-81de-4a0e-bc6c-fb6efe5a6af7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035651 Oct 01 04:18:43.320953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 68/124] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:18:43.941151 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7ff8fa5e-8140-47ee-b8f5-507c4195f530 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:43.942116 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7ff8fa5e-8140-47ee-b8f5-507c4195f530 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:43.949566 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ff8fa5e-8140-47ee-b8f5-507c4195f530 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:43.950049 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ff8fa5e-8140-47ee-b8f5-507c4195f530 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:43.950484 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ff8fa5e-8140-47ee-b8f5-507c4195f530 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:43.952196 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ff8fa5e-8140-47ee-b8f5-507c4195f530 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:43.952770 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ff8fa5e-8140-47ee-b8f5-507c4195f530 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:43.952770 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ff8fa5e-8140-47ee-b8f5-507c4195f530 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:44.102713 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7ff8fa5e-8140-47ee-b8f5-507c4195f530 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:44.106168 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:44.112128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7ff8fa5e-8140-47ee-b8f5-507c4195f530 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1548 microversion: 2.1 time: 0.176342 Oct 01 04:18:44.112707 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 69/125] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:43 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1548 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:44.125185 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5a36600b-58cf-4d07-8e32-d018292a99c7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:44.125991 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5a36600b-58cf-4d07-8e32-d018292a99c7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:44.133787 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a36600b-58cf-4d07-8e32-d018292a99c7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:44.134279 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a36600b-58cf-4d07-8e32-d018292a99c7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:44.134994 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a36600b-58cf-4d07-8e32-d018292a99c7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:44.136243 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a36600b-58cf-4d07-8e32-d018292a99c7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:44.136698 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a36600b-58cf-4d07-8e32-d018292a99c7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:44.137264 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a36600b-58cf-4d07-8e32-d018292a99c7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:44.288360 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-5a36600b-58cf-4d07-8e32-d018292a99c7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:44.296610 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-5a36600b-58cf-4d07-8e32-d018292a99c7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:44.298299 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-5a36600b-58cf-4d07-8e32-d018292a99c7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:44.299518 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5a36600b-58cf-4d07-8e32-d018292a99c7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1408 microversion: 2.20 time: 0.179420 Oct 01 04:18:44.300102 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 70/126] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:44 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:18:44.316230 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-24b7361b-3c5d-452d-abed-9bb463894bad tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:44.316795 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-24b7361b-3c5d-452d-abed-9bb463894bad tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:44.322911 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24b7361b-3c5d-452d-abed-9bb463894bad tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:44.323469 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24b7361b-3c5d-452d-abed-9bb463894bad tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:44.323912 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24b7361b-3c5d-452d-abed-9bb463894bad tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:44.324599 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24b7361b-3c5d-452d-abed-9bb463894bad tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:44.325088 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24b7361b-3c5d-452d-abed-9bb463894bad tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:44.325511 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-24b7361b-3c5d-452d-abed-9bb463894bad tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:44.463255 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-24b7361b-3c5d-452d-abed-9bb463894bad tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.151670 Oct 01 04:18:44.464186 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 71/127] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 1 04:18:44 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69/os-interface => generated 284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:18:44.471394 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-70ca0d75-59b0-410f-ace4-bb2abcef7b09 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:44.472669 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-70ca0d75-59b0-410f-ace4-bb2abcef7b09 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:44.494985 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70ca0d75-59b0-410f-ace4-bb2abcef7b09 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:44.496732 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70ca0d75-59b0-410f-ace4-bb2abcef7b09 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:44.497589 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70ca0d75-59b0-410f-ace4-bb2abcef7b09 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:44.500424 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70ca0d75-59b0-410f-ace4-bb2abcef7b09 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:44.501159 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70ca0d75-59b0-410f-ace4-bb2abcef7b09 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:44.501804 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70ca0d75-59b0-410f-ace4-bb2abcef7b09 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:45.171000 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-70ca0d75-59b0-410f-ace4-bb2abcef7b09 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:45.190280 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-70ca0d75-59b0-410f-ace4-bb2abcef7b09 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1322 microversion: 2.1 time: 0.724197 Oct 01 04:18:45.193729 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 72/128] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:44 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1322 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:45.245916 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5fdc495a-84a5-45d4-8a59-bfd9752779f6 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "POST /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.305795 Oct 01 04:18:45.262377 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 57/129] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 1 04:18:42 2022] POST /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924/os-volume_attachments => generated 194 bytes in 2329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:18:45.329092 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-22128672-4a75-4d0d-a52f-062588497fa1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:45.330075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-22128672-4a75-4d0d-a52f-062588497fa1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:45.337266 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22128672-4a75-4d0d-a52f-062588497fa1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:45.338085 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22128672-4a75-4d0d-a52f-062588497fa1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:45.338823 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22128672-4a75-4d0d-a52f-062588497fa1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:45.339675 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22128672-4a75-4d0d-a52f-062588497fa1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:45.340312 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22128672-4a75-4d0d-a52f-062588497fa1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:45.341895 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-22128672-4a75-4d0d-a52f-062588497fa1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:45.848760 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-22128672-4a75-4d0d-a52f-062588497fa1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:45.865521 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-22128672-4a75-4d0d-a52f-062588497fa1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:45.878971 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-22128672-4a75-4d0d-a52f-062588497fa1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:45.883032 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-22128672-4a75-4d0d-a52f-062588497fa1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1408 microversion: 2.20 time: 0.560132 Oct 01 04:18:45.907265 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 73/130] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:45 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1408 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:18:46.224893 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8c01aaaf-6df6-449c-a3ba-42e355fe2f7b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:46.226385 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8c01aaaf-6df6-449c-a3ba-42e355fe2f7b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:46.236136 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c01aaaf-6df6-449c-a3ba-42e355fe2f7b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:46.237501 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c01aaaf-6df6-449c-a3ba-42e355fe2f7b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:46.238209 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c01aaaf-6df6-449c-a3ba-42e355fe2f7b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:46.239235 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c01aaaf-6df6-449c-a3ba-42e355fe2f7b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:46.240060 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c01aaaf-6df6-449c-a3ba-42e355fe2f7b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:46.240692 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c01aaaf-6df6-449c-a3ba-42e355fe2f7b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:46.544599 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-8c01aaaf-6df6-449c-a3ba-42e355fe2f7b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:46.553551 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:46.569153 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8c01aaaf-6df6-449c-a3ba-42e355fe2f7b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1322 microversion: 2.1 time: 0.352710 Oct 01 04:18:46.572350 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 58/131] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:46 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1322 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:46.915774 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1033e679-6508-4db4-b506-d2162cf804b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:46.916381 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1033e679-6508-4db4-b506-d2162cf804b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:46.942810 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1033e679-6508-4db4-b506-d2162cf804b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:46.951058 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1033e679-6508-4db4-b506-d2162cf804b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:46.951628 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1033e679-6508-4db4-b506-d2162cf804b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:46.952403 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1033e679-6508-4db4-b506-d2162cf804b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:46.952872 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1033e679-6508-4db4-b506-d2162cf804b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:46.956485 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1033e679-6508-4db4-b506-d2162cf804b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:47.298412 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-18daa8e9-4ba2-4fcc-a2df-2297cfa18aca req-703162b6-e656-4ee4-b425-44c323ae72c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f161c249-ba0f-42c9-a1f0-8c7913b666f9", "name": "network-vif-plugged", "status": "completed", "tag": "94c6e2ab-bf5f-4d4a-87aa-757bce04cc43"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:18:47.323153 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-18daa8e9-4ba2-4fcc-a2df-2297cfa18aca req-703162b6-e656-4ee4-b425-44c323ae72c5 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:47.323865 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-18daa8e9-4ba2-4fcc-a2df-2297cfa18aca req-703162b6-e656-4ee4-b425-44c323ae72c5 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:47.324457 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-18daa8e9-4ba2-4fcc-a2df-2297cfa18aca req-703162b6-e656-4ee4-b425-44c323ae72c5 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:47.353816 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-18daa8e9-4ba2-4fcc-a2df-2297cfa18aca req-703162b6-e656-4ee4-b425-44c323ae72c5 service nova] Creating event network-vif-plugged:94c6e2ab-bf5f-4d4a-87aa-757bce04cc43 for instance f161c249-ba0f-42c9-a1f0-8c7913b666f9 on hv-cinder-86004 Oct 01 04:18:47.366094 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-18daa8e9-4ba2-4fcc-a2df-2297cfa18aca req-703162b6-e656-4ee4-b425-44c323ae72c5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071942 Oct 01 04:18:47.367297 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 59/132] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:18:47.460191 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1033e679-6508-4db4-b506-d2162cf804b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:47.478406 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1033e679-6508-4db4-b506-d2162cf804b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:47.480289 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1033e679-6508-4db4-b506-d2162cf804b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:47.484132 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1033e679-6508-4db4-b506-d2162cf804b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1408 microversion: 2.20 time: 0.572849 Oct 01 04:18:47.506132 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 74/133] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:46 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1408 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:18:47.606752 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b9d53848-ffb2-4210-a4bf-ca85e30bfad7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:47.613230 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b9d53848-ffb2-4210-a4bf-ca85e30bfad7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:47.648404 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9d53848-ffb2-4210-a4bf-ca85e30bfad7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:47.648981 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9d53848-ffb2-4210-a4bf-ca85e30bfad7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:47.650827 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9d53848-ffb2-4210-a4bf-ca85e30bfad7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:47.654878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9d53848-ffb2-4210-a4bf-ca85e30bfad7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:47.655389 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9d53848-ffb2-4210-a4bf-ca85e30bfad7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:47.667189 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b9d53848-ffb2-4210-a4bf-ca85e30bfad7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:47.899854 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-4ee3d99a-1deb-40e9-9ecf-e9feb4fb799e req-713ebc29-7ce4-46a7-b437-134234ae28b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2643a3f-906d-4cb4-8b4f-f2a63557ab69", "tag": "ada360f6-273f-42d3-babd-7015209fbaac"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:18:47.923874 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4ee3d99a-1deb-40e9-9ecf-e9feb4fb799e req-713ebc29-7ce4-46a7-b437-134234ae28b6 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:47.924552 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4ee3d99a-1deb-40e9-9ecf-e9feb4fb799e req-713ebc29-7ce4-46a7-b437-134234ae28b6 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:47.924834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4ee3d99a-1deb-40e9-9ecf-e9feb4fb799e req-713ebc29-7ce4-46a7-b437-134234ae28b6 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:47.948858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-4ee3d99a-1deb-40e9-9ecf-e9feb4fb799e req-713ebc29-7ce4-46a7-b437-134234ae28b6 service nova] Creating event network-changed:ada360f6-273f-42d3-babd-7015209fbaac for instance c2643a3f-906d-4cb4-8b4f-f2a63557ab69 on hv-cinder-86004 Oct 01 04:18:47.960069 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-4ee3d99a-1deb-40e9-9ecf-e9feb4fb799e req-713ebc29-7ce4-46a7-b437-134234ae28b6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185614 Oct 01 04:18:47.961239 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 75/134] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:18:47.994412 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-b9d53848-ffb2-4210-a4bf-ca85e30bfad7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:48.008469 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b9d53848-ffb2-4210-a4bf-ca85e30bfad7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1322 microversion: 2.1 time: 0.413779 Oct 01 04:18:48.010199 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 60/135] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:47 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1322 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:48.534227 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3f7ff9ff-0adc-429e-8489-30097126889d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:48.535810 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3f7ff9ff-0adc-429e-8489-30097126889d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:48.549059 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f7ff9ff-0adc-429e-8489-30097126889d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:48.549915 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f7ff9ff-0adc-429e-8489-30097126889d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:48.550590 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f7ff9ff-0adc-429e-8489-30097126889d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:48.551372 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f7ff9ff-0adc-429e-8489-30097126889d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:48.552060 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f7ff9ff-0adc-429e-8489-30097126889d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:48.552718 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3f7ff9ff-0adc-429e-8489-30097126889d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:48.877240 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-3f7ff9ff-0adc-429e-8489-30097126889d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:48.890743 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-3f7ff9ff-0adc-429e-8489-30097126889d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:48.893870 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-3f7ff9ff-0adc-429e-8489-30097126889d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:48.896600 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3f7ff9ff-0adc-429e-8489-30097126889d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1408 microversion: 2.20 time: 0.386237 Oct 01 04:18:48.898064 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 76/136] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:48 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1408 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:18:49.034193 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dbd0cc51-d95c-48ec-ba4d-05bea861fe03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:49.038332 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dbd0cc51-d95c-48ec-ba4d-05bea861fe03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:49.051406 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dbd0cc51-d95c-48ec-ba4d-05bea861fe03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:49.051904 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dbd0cc51-d95c-48ec-ba4d-05bea861fe03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:49.052346 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dbd0cc51-d95c-48ec-ba4d-05bea861fe03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:49.053097 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dbd0cc51-d95c-48ec-ba4d-05bea861fe03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:49.053561 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dbd0cc51-d95c-48ec-ba4d-05bea861fe03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:49.053993 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dbd0cc51-d95c-48ec-ba4d-05bea861fe03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:49.314388 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-dbd0cc51-d95c-48ec-ba4d-05bea861fe03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:49.354375 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dbd0cc51-d95c-48ec-ba4d-05bea861fe03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1322 microversion: 2.1 time: 0.323999 Oct 01 04:18:49.363723 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 61/137] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:49 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1322 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:49.410573 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-0b2d9ac4-a2ee-4176-9e9a-3059430d9aed req-05590496-483a-4b70-8705-a08b26553bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e14e3570-67e7-43d6-bcaf-6688168956b2", "name": "network-vif-plugged", "status": "completed", "tag": "28ed6420-e14b-48a2-a448-a8ab736b93af"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:18:49.433087 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0b2d9ac4-a2ee-4176-9e9a-3059430d9aed req-05590496-483a-4b70-8705-a08b26553bc7 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:49.433874 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0b2d9ac4-a2ee-4176-9e9a-3059430d9aed req-05590496-483a-4b70-8705-a08b26553bc7 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:49.434330 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0b2d9ac4-a2ee-4176-9e9a-3059430d9aed req-05590496-483a-4b70-8705-a08b26553bc7 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:49.482128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-0b2d9ac4-a2ee-4176-9e9a-3059430d9aed req-05590496-483a-4b70-8705-a08b26553bc7 service nova] Creating event network-vif-plugged:28ed6420-e14b-48a2-a448-a8ab736b93af for instance e14e3570-67e7-43d6-bcaf-6688168956b2 on hv-cinder-86004 Oct 01 04:18:49.492588 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-0b2d9ac4-a2ee-4176-9e9a-3059430d9aed req-05590496-483a-4b70-8705-a08b26553bc7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085849 Oct 01 04:18:49.493889 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 77/138] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:18:49.931763 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c3575bff-eabc-4b7a-9475-5432f46dd99d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:49.932373 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c3575bff-eabc-4b7a-9475-5432f46dd99d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:49.939097 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c3575bff-eabc-4b7a-9475-5432f46dd99d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:49.939622 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c3575bff-eabc-4b7a-9475-5432f46dd99d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:49.940385 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c3575bff-eabc-4b7a-9475-5432f46dd99d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:49.941526 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c3575bff-eabc-4b7a-9475-5432f46dd99d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:49.942092 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c3575bff-eabc-4b7a-9475-5432f46dd99d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:49.942551 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c3575bff-eabc-4b7a-9475-5432f46dd99d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:50.165322 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c3575bff-eabc-4b7a-9475-5432f46dd99d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:50.181362 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c3575bff-eabc-4b7a-9475-5432f46dd99d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:50.194779 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c3575bff-eabc-4b7a-9475-5432f46dd99d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:50.196134 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c3575bff-eabc-4b7a-9475-5432f46dd99d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1408 microversion: 2.20 time: 0.269895 Oct 01 04:18:50.196805 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 62/139] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:49 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1408 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:18:50.392181 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2e18c1af-b6c7-4431-9017-2bfe4f5c8c23 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:50.392889 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2e18c1af-b6c7-4431-9017-2bfe4f5c8c23 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:50.400806 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e18c1af-b6c7-4431-9017-2bfe4f5c8c23 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:50.402012 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e18c1af-b6c7-4431-9017-2bfe4f5c8c23 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:50.402633 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e18c1af-b6c7-4431-9017-2bfe4f5c8c23 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:50.403673 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e18c1af-b6c7-4431-9017-2bfe4f5c8c23 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:50.404285 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e18c1af-b6c7-4431-9017-2bfe4f5c8c23 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:50.406026 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e18c1af-b6c7-4431-9017-2bfe4f5c8c23 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:50.658946 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2e18c1af-b6c7-4431-9017-2bfe4f5c8c23 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:50.669248 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2e18c1af-b6c7-4431-9017-2bfe4f5c8c23 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1517 microversion: 2.1 time: 0.285013 Oct 01 04:18:50.670324 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 78/140] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:50 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1517 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:50.693542 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2b2f15c1-f39f-4a63-a12b-a20dbb39d83b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:18:50.696014 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2b2f15c1-f39f-4a63-a12b-a20dbb39d83b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:50.702771 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b2f15c1-f39f-4a63-a12b-a20dbb39d83b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:50.703468 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b2f15c1-f39f-4a63-a12b-a20dbb39d83b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:50.704259 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b2f15c1-f39f-4a63-a12b-a20dbb39d83b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:50.704998 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b2f15c1-f39f-4a63-a12b-a20dbb39d83b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:50.705709 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b2f15c1-f39f-4a63-a12b-a20dbb39d83b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:50.706288 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2b2f15c1-f39f-4a63-a12b-a20dbb39d83b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:50.741502 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-2b2f15c1-f39f-4a63-a12b-a20dbb39d83b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lazy-loading 'flavor' on Instance uuid f161c249-ba0f-42c9-a1f0-8c7913b666f9 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:18:50.896615 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2b2f15c1-f39f-4a63-a12b-a20dbb39d83b tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "POST /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9/action" status: 200 len: 32 microversion: 2.1 time: 0.207222 Oct 01 04:18:50.898121 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 63/141] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 1 04:18:50 2022] POST /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9/action => generated 32 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 04:18:50.913329 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2800b399-7ed4-4ee4-9dbd-075e9e5482cb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:50.914422 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2800b399-7ed4-4ee4-9dbd-075e9e5482cb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:50.926964 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2800b399-7ed4-4ee4-9dbd-075e9e5482cb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:50.927483 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2800b399-7ed4-4ee4-9dbd-075e9e5482cb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:50.928017 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2800b399-7ed4-4ee4-9dbd-075e9e5482cb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:50.928816 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2800b399-7ed4-4ee4-9dbd-075e9e5482cb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:50.929348 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2800b399-7ed4-4ee4-9dbd-075e9e5482cb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:50.929773 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2800b399-7ed4-4ee4-9dbd-075e9e5482cb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:51.106215 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2800b399-7ed4-4ee4-9dbd-075e9e5482cb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:51.112404 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2800b399-7ed4-4ee4-9dbd-075e9e5482cb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.208009 Oct 01 04:18:51.113395 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 79/142] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:50 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:51.229533 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e745f9f5-bf89-4a4c-83b3-69a03b8ab3d3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:51.230230 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e745f9f5-bf89-4a4c-83b3-69a03b8ab3d3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:51.237690 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e745f9f5-bf89-4a4c-83b3-69a03b8ab3d3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:51.238200 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e745f9f5-bf89-4a4c-83b3-69a03b8ab3d3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:51.238732 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e745f9f5-bf89-4a4c-83b3-69a03b8ab3d3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:51.239321 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e745f9f5-bf89-4a4c-83b3-69a03b8ab3d3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:51.239730 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e745f9f5-bf89-4a4c-83b3-69a03b8ab3d3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:51.240154 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e745f9f5-bf89-4a4c-83b3-69a03b8ab3d3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:51.473520 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-e745f9f5-bf89-4a4c-83b3-69a03b8ab3d3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:51.484057 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-e745f9f5-bf89-4a4c-83b3-69a03b8ab3d3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:51.492811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-e745f9f5-bf89-4a4c-83b3-69a03b8ab3d3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:51.492811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e745f9f5-bf89-4a4c-83b3-69a03b8ab3d3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1408 microversion: 2.20 time: 0.268295 Oct 01 04:18:51.493318 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 64/143] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:51 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1408 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:18:52.136641 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-68b23f77-1bef-4e56-9915-02668d150a11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:52.137446 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-68b23f77-1bef-4e56-9915-02668d150a11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:52.143530 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68b23f77-1bef-4e56-9915-02668d150a11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:52.144091 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68b23f77-1bef-4e56-9915-02668d150a11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:52.144742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68b23f77-1bef-4e56-9915-02668d150a11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:52.145687 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68b23f77-1bef-4e56-9915-02668d150a11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:52.146215 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68b23f77-1bef-4e56-9915-02668d150a11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:52.146730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-68b23f77-1bef-4e56-9915-02668d150a11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:52.364844 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-68b23f77-1bef-4e56-9915-02668d150a11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:52.375658 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-68b23f77-1bef-4e56-9915-02668d150a11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.243444 Oct 01 04:18:52.376250 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 80/144] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:52 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:52.520609 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-33d62368-6b9b-4801-9cd3-26a6121d9bdf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:52.521238 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-33d62368-6b9b-4801-9cd3-26a6121d9bdf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:52.530842 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33d62368-6b9b-4801-9cd3-26a6121d9bdf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:52.531821 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33d62368-6b9b-4801-9cd3-26a6121d9bdf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:52.532463 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33d62368-6b9b-4801-9cd3-26a6121d9bdf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:52.533542 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33d62368-6b9b-4801-9cd3-26a6121d9bdf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:52.534182 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33d62368-6b9b-4801-9cd3-26a6121d9bdf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:52.534621 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33d62368-6b9b-4801-9cd3-26a6121d9bdf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:52.705734 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-33d62368-6b9b-4801-9cd3-26a6121d9bdf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:52.718478 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-33d62368-6b9b-4801-9cd3-26a6121d9bdf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:52.720076 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-33d62368-6b9b-4801-9cd3-26a6121d9bdf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:52.721282 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-33d62368-6b9b-4801-9cd3-26a6121d9bdf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1408 microversion: 2.20 time: 0.205167 Oct 01 04:18:52.722356 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 65/145] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:52 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:18:53.400272 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7aea03fc-6c92-4615-b6c8-f23c8fe51cfc tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:53.400826 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7aea03fc-6c92-4615-b6c8-f23c8fe51cfc tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:53.403996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=93 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:53.409113 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7aea03fc-6c92-4615-b6c8-f23c8fe51cfc tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:53.409601 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7aea03fc-6c92-4615-b6c8-f23c8fe51cfc tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:53.410031 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7aea03fc-6c92-4615-b6c8-f23c8fe51cfc tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:53.410726 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7aea03fc-6c92-4615-b6c8-f23c8fe51cfc tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:53.411172 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7aea03fc-6c92-4615-b6c8-f23c8fe51cfc tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:53.411587 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7aea03fc-6c92-4615-b6c8-f23c8fe51cfc tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:53.548104 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7aea03fc-6c92-4615-b6c8-f23c8fe51cfc tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:53.555965 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7aea03fc-6c92-4615-b6c8-f23c8fe51cfc tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.160252 Oct 01 04:18:53.556526 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 81/146] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:53 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:53.755861 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c09dce0f-1fa5-46cb-a1a9-eefa1ef81a5c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:53.756484 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c09dce0f-1fa5-46cb-a1a9-eefa1ef81a5c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:53.763522 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c09dce0f-1fa5-46cb-a1a9-eefa1ef81a5c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:53.764167 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c09dce0f-1fa5-46cb-a1a9-eefa1ef81a5c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:53.764622 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c09dce0f-1fa5-46cb-a1a9-eefa1ef81a5c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:53.765553 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c09dce0f-1fa5-46cb-a1a9-eefa1ef81a5c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:53.766009 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c09dce0f-1fa5-46cb-a1a9-eefa1ef81a5c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:53.766602 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c09dce0f-1fa5-46cb-a1a9-eefa1ef81a5c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:53.908336 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c09dce0f-1fa5-46cb-a1a9-eefa1ef81a5c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:53.916919 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c09dce0f-1fa5-46cb-a1a9-eefa1ef81a5c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:53.918445 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c09dce0f-1fa5-46cb-a1a9-eefa1ef81a5c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:53.919724 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c09dce0f-1fa5-46cb-a1a9-eefa1ef81a5c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1408 microversion: 2.20 time: 0.174002 Oct 01 04:18:53.920457 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 66/147] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:53 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:18:54.579572 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e994ae53-0360-4d25-bf60-3dee1b9c1f88 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:54.580958 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e994ae53-0360-4d25-bf60-3dee1b9c1f88 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:54.587544 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e994ae53-0360-4d25-bf60-3dee1b9c1f88 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:54.587998 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e994ae53-0360-4d25-bf60-3dee1b9c1f88 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:54.588600 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e994ae53-0360-4d25-bf60-3dee1b9c1f88 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:54.589516 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e994ae53-0360-4d25-bf60-3dee1b9c1f88 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:54.589806 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e994ae53-0360-4d25-bf60-3dee1b9c1f88 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:54.590248 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e994ae53-0360-4d25-bf60-3dee1b9c1f88 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:54.721287 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e994ae53-0360-4d25-bf60-3dee1b9c1f88 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:54.728915 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e994ae53-0360-4d25-bf60-3dee1b9c1f88 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.153895 Oct 01 04:18:54.729502 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 82/148] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:54 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:54.946052 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e6b1151f-c22d-400f-942e-6daa90ff6a79 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:54.946764 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e6b1151f-c22d-400f-942e-6daa90ff6a79 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:54.953581 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6b1151f-c22d-400f-942e-6daa90ff6a79 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:54.954069 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6b1151f-c22d-400f-942e-6daa90ff6a79 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:54.954565 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6b1151f-c22d-400f-942e-6daa90ff6a79 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:54.955260 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6b1151f-c22d-400f-942e-6daa90ff6a79 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:54.955721 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6b1151f-c22d-400f-942e-6daa90ff6a79 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:54.956203 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e6b1151f-c22d-400f-942e-6daa90ff6a79 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:55.086779 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-e6b1151f-c22d-400f-942e-6daa90ff6a79 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:55.095903 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-e6b1151f-c22d-400f-942e-6daa90ff6a79 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:55.097377 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-e6b1151f-c22d-400f-942e-6daa90ff6a79 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:55.098537 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e6b1151f-c22d-400f-942e-6daa90ff6a79 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1600 microversion: 2.20 time: 0.156796 Oct 01 04:18:55.099088 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 67/149] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:18:54 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1600 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:18:55.125847 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5957e1f6-1a0f-4d38-949d-abc1e4f18c3f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:55.126345 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5957e1f6-1a0f-4d38-949d-abc1e4f18c3f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:55.132161 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5957e1f6-1a0f-4d38-949d-abc1e4f18c3f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:55.132646 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5957e1f6-1a0f-4d38-949d-abc1e4f18c3f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:55.133121 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5957e1f6-1a0f-4d38-949d-abc1e4f18c3f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:55.133852 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5957e1f6-1a0f-4d38-949d-abc1e4f18c3f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:55.134311 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5957e1f6-1a0f-4d38-949d-abc1e4f18c3f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:55.134737 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5957e1f6-1a0f-4d38-949d-abc1e4f18c3f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:55.221668 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5957e1f6-1a0f-4d38-949d-abc1e4f18c3f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.099979 Oct 01 04:18:55.222261 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 83/150] 10.222.0.26 () {60 vars in 1316 bytes} [Sat Oct 1 04:18:55 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 04:18:55.752450 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d246cea2-a7c9-4db2-a5cd-18e353df069a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:55.753368 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d246cea2-a7c9-4db2-a5cd-18e353df069a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:55.760052 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d246cea2-a7c9-4db2-a5cd-18e353df069a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:55.765926 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d246cea2-a7c9-4db2-a5cd-18e353df069a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:55.766670 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d246cea2-a7c9-4db2-a5cd-18e353df069a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:55.770757 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d246cea2-a7c9-4db2-a5cd-18e353df069a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:55.771641 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d246cea2-a7c9-4db2-a5cd-18e353df069a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:55.773656 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d246cea2-a7c9-4db2-a5cd-18e353df069a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:56.047584 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-d246cea2-a7c9-4db2-a5cd-18e353df069a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:56.056798 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d246cea2-a7c9-4db2-a5cd-18e353df069a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.308891 Oct 01 04:18:56.058297 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 68/151] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:55 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:56.458897 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-520f82ff-1c55-4907-a622-6f1b385d94f7 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:56.459508 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-520f82ff-1c55-4907-a622-6f1b385d94f7 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:56.465628 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-520f82ff-1c55-4907-a622-6f1b385d94f7 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:56.466192 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-520f82ff-1c55-4907-a622-6f1b385d94f7 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:56.467241 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-520f82ff-1c55-4907-a622-6f1b385d94f7 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:56.467939 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-520f82ff-1c55-4907-a622-6f1b385d94f7 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:56.468398 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-520f82ff-1c55-4907-a622-6f1b385d94f7 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:56.468824 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-520f82ff-1c55-4907-a622-6f1b385d94f7 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:56.494413 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-520f82ff-1c55-4907-a622-6f1b385d94f7 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 04:18:56.597211 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-520f82ff-1c55-4907-a622-6f1b385d94f7 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 204 len: 0 microversion: 2.1 time: 0.141797 Oct 01 04:18:56.597802 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 84/152] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 1 04:18:56 2022] DELETE /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 04:18:56.606907 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-06570a52-c8cd-405e-8265-c2b811f53733 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:56.607702 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-06570a52-c8cd-405e-8265-c2b811f53733 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:56.613725 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06570a52-c8cd-405e-8265-c2b811f53733 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:56.614212 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06570a52-c8cd-405e-8265-c2b811f53733 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:56.614653 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06570a52-c8cd-405e-8265-c2b811f53733 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:56.615352 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06570a52-c8cd-405e-8265-c2b811f53733 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:56.615837 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06570a52-c8cd-405e-8265-c2b811f53733 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:56.616236 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-06570a52-c8cd-405e-8265-c2b811f53733 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:56.756010 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-06570a52-c8cd-405e-8265-c2b811f53733 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:56.764254 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-06570a52-c8cd-405e-8265-c2b811f53733 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1555 microversion: 2.1 time: 0.161859 Oct 01 04:18:56.764822 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 69/153] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:56 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:57.052084 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-e7ff7bbe-dcc5-4690-914e-dedba9824b69 req-d9a6b17b-8c74-41ce-b33d-aaac54508cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e14e3570-67e7-43d6-bcaf-6688168956b2", "tag": "28ed6420-e14b-48a2-a448-a8ab736b93af"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:18:57.061740 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e7ff7bbe-dcc5-4690-914e-dedba9824b69 req-d9a6b17b-8c74-41ce-b33d-aaac54508cf8 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:57.062223 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e7ff7bbe-dcc5-4690-914e-dedba9824b69 req-d9a6b17b-8c74-41ce-b33d-aaac54508cf8 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:57.062657 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e7ff7bbe-dcc5-4690-914e-dedba9824b69 req-d9a6b17b-8c74-41ce-b33d-aaac54508cf8 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:57.079765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-47e0e13e-07bd-421f-b5ed-b68ca0a8e623 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:57.080372 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-47e0e13e-07bd-421f-b5ed-b68ca0a8e623 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:57.089104 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=79 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:57.092514 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47e0e13e-07bd-421f-b5ed-b68ca0a8e623 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:57.093209 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47e0e13e-07bd-421f-b5ed-b68ca0a8e623 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:57.093960 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47e0e13e-07bd-421f-b5ed-b68ca0a8e623 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:57.095090 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-e7ff7bbe-dcc5-4690-914e-dedba9824b69 req-d9a6b17b-8c74-41ce-b33d-aaac54508cf8 service nova] Creating event network-changed:28ed6420-e14b-48a2-a448-a8ab736b93af for instance e14e3570-67e7-43d6-bcaf-6688168956b2 on hv-cinder-86004 Oct 01 04:18:57.106883 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-e7ff7bbe-dcc5-4690-914e-dedba9824b69 req-d9a6b17b-8c74-41ce-b33d-aaac54508cf8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058852 Oct 01 04:18:57.108024 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47e0e13e-07bd-421f-b5ed-b68ca0a8e623 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:57.108651 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 85/154] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:18:57.109057 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47e0e13e-07bd-421f-b5ed-b68ca0a8e623 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:57.109643 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47e0e13e-07bd-421f-b5ed-b68ca0a8e623 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:57.303371 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-47e0e13e-07bd-421f-b5ed-b68ca0a8e623 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:57.312358 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-47e0e13e-07bd-421f-b5ed-b68ca0a8e623 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.236682 Oct 01 04:18:57.312983 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 70/155] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:57 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:57.790259 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c4e9c5e4-0e23-4f2b-8a81-24717be10f82 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:57.790955 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c4e9c5e4-0e23-4f2b-8a81-24717be10f82 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:57.797472 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4e9c5e4-0e23-4f2b-8a81-24717be10f82 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:57.797955 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4e9c5e4-0e23-4f2b-8a81-24717be10f82 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:57.798393 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4e9c5e4-0e23-4f2b-8a81-24717be10f82 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:57.799079 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4e9c5e4-0e23-4f2b-8a81-24717be10f82 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:57.799538 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4e9c5e4-0e23-4f2b-8a81-24717be10f82 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:57.799961 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c4e9c5e4-0e23-4f2b-8a81-24717be10f82 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:57.932727 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c4e9c5e4-0e23-4f2b-8a81-24717be10f82 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:57.942873 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c4e9c5e4-0e23-4f2b-8a81-24717be10f82 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1555 microversion: 2.1 time: 0.157057 Oct 01 04:18:57.943610 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 86/156] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:57 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:58.344975 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-00c87890-af85-48d5-94c7-d2f5ad0fbfa9 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:58.345698 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-00c87890-af85-48d5-94c7-d2f5ad0fbfa9 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:58.352139 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00c87890-af85-48d5-94c7-d2f5ad0fbfa9 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:58.352677 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00c87890-af85-48d5-94c7-d2f5ad0fbfa9 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:58.353205 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00c87890-af85-48d5-94c7-d2f5ad0fbfa9 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:58.353986 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00c87890-af85-48d5-94c7-d2f5ad0fbfa9 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:58.354477 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00c87890-af85-48d5-94c7-d2f5ad0fbfa9 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:58.354933 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-00c87890-af85-48d5-94c7-d2f5ad0fbfa9 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:58.491316 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-00c87890-af85-48d5-94c7-d2f5ad0fbfa9 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:58.499892 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-00c87890-af85-48d5-94c7-d2f5ad0fbfa9 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.167927 Oct 01 04:18:58.500460 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 71/157] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:58 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:58.966498 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6871dd15-6ca8-4de9-a2ee-f2dc530c36ad tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:58.967171 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6871dd15-6ca8-4de9-a2ee-f2dc530c36ad tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:58.973627 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6871dd15-6ca8-4de9-a2ee-f2dc530c36ad tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:58.974106 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6871dd15-6ca8-4de9-a2ee-f2dc530c36ad tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:58.974544 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6871dd15-6ca8-4de9-a2ee-f2dc530c36ad tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:58.975223 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6871dd15-6ca8-4de9-a2ee-f2dc530c36ad tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:58.975679 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6871dd15-6ca8-4de9-a2ee-f2dc530c36ad tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:58.976099 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6871dd15-6ca8-4de9-a2ee-f2dc530c36ad tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:58.994207 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:18:59.105036 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-6871dd15-6ca8-4de9-a2ee-f2dc530c36ad tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:59.113202 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6871dd15-6ca8-4de9-a2ee-f2dc530c36ad tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1555 microversion: 2.1 time: 0.150474 Oct 01 04:18:59.113757 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 87/158] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:58 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:18:59.522748 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0b763d9c-058a-4d5a-8aab-23cee8283831 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:18:59.523332 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0b763d9c-058a-4d5a-8aab-23cee8283831 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:18:59.530006 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b763d9c-058a-4d5a-8aab-23cee8283831 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:59.530477 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b763d9c-058a-4d5a-8aab-23cee8283831 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:59.530903 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b763d9c-058a-4d5a-8aab-23cee8283831 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:59.531587 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b763d9c-058a-4d5a-8aab-23cee8283831 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:18:59.532038 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b763d9c-058a-4d5a-8aab-23cee8283831 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:18:59.532455 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0b763d9c-058a-4d5a-8aab-23cee8283831 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:18:59.662571 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-0b763d9c-058a-4d5a-8aab-23cee8283831 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:18:59.671455 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0b763d9c-058a-4d5a-8aab-23cee8283831 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.152685 Oct 01 04:18:59.672022 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 72/159] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:18:59 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:00.136020 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-de62ca8f-e3dd-4625-83ee-8e856f1f5505 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:00.136653 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-de62ca8f-e3dd-4625-83ee-8e856f1f5505 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:00.142948 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de62ca8f-e3dd-4625-83ee-8e856f1f5505 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:00.143368 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de62ca8f-e3dd-4625-83ee-8e856f1f5505 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:00.143797 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de62ca8f-e3dd-4625-83ee-8e856f1f5505 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:00.144481 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de62ca8f-e3dd-4625-83ee-8e856f1f5505 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:00.144952 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de62ca8f-e3dd-4625-83ee-8e856f1f5505 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:00.145376 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de62ca8f-e3dd-4625-83ee-8e856f1f5505 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:00.280807 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-de62ca8f-e3dd-4625-83ee-8e856f1f5505 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:00.288918 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-de62ca8f-e3dd-4625-83ee-8e856f1f5505 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1555 microversion: 2.1 time: 0.156742 Oct 01 04:19:00.289500 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 88/160] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:00 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:00.694816 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-72a80b0a-be6c-4c04-a8a0-390d3c67371e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:00.695427 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-72a80b0a-be6c-4c04-a8a0-390d3c67371e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:00.701717 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72a80b0a-be6c-4c04-a8a0-390d3c67371e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:00.702199 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72a80b0a-be6c-4c04-a8a0-390d3c67371e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:00.702628 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72a80b0a-be6c-4c04-a8a0-390d3c67371e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:00.703323 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72a80b0a-be6c-4c04-a8a0-390d3c67371e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:00.703777 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72a80b0a-be6c-4c04-a8a0-390d3c67371e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:00.704200 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-72a80b0a-be6c-4c04-a8a0-390d3c67371e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:00.837192 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-72a80b0a-be6c-4c04-a8a0-390d3c67371e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:00.846107 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-72a80b0a-be6c-4c04-a8a0-390d3c67371e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.155170 Oct 01 04:19:00.846672 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 73/161] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:00 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:01.312060 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-534b5e96-c897-4479-b778-7a58388fd413 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:01.312674 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-534b5e96-c897-4479-b778-7a58388fd413 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:01.318954 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-534b5e96-c897-4479-b778-7a58388fd413 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:01.319487 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-534b5e96-c897-4479-b778-7a58388fd413 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:01.319892 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-534b5e96-c897-4479-b778-7a58388fd413 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:01.320810 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-534b5e96-c897-4479-b778-7a58388fd413 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:01.321297 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-534b5e96-c897-4479-b778-7a58388fd413 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:01.321876 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-534b5e96-c897-4479-b778-7a58388fd413 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:01.529493 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-534b5e96-c897-4479-b778-7a58388fd413 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:01.538477 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-534b5e96-c897-4479-b778-7a58388fd413 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1555 microversion: 2.1 time: 0.230688 Oct 01 04:19:01.539372 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 89/162] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:01 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1555 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:01.870804 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3adcb5b9-d777-4cf2-99bb-c76d937a1936 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:01.874480 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3adcb5b9-d777-4cf2-99bb-c76d937a1936 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:01.882581 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3adcb5b9-d777-4cf2-99bb-c76d937a1936 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:01.883086 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3adcb5b9-d777-4cf2-99bb-c76d937a1936 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:01.884074 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3adcb5b9-d777-4cf2-99bb-c76d937a1936 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:01.885164 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3adcb5b9-d777-4cf2-99bb-c76d937a1936 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:01.885363 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3adcb5b9-d777-4cf2-99bb-c76d937a1936 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:01.885680 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3adcb5b9-d777-4cf2-99bb-c76d937a1936 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:01.890864 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:02.078392 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-3adcb5b9-d777-4cf2-99bb-c76d937a1936 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:02.086653 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3adcb5b9-d777-4cf2-99bb-c76d937a1936 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.221362 Oct 01 04:19:02.087529 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 74/163] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:01 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:02.562065 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a50ec56b-f9eb-459e-84af-7548216f299b tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:02.562682 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a50ec56b-f9eb-459e-84af-7548216f299b tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:02.568661 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a50ec56b-f9eb-459e-84af-7548216f299b tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:02.569385 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a50ec56b-f9eb-459e-84af-7548216f299b tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:02.569967 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a50ec56b-f9eb-459e-84af-7548216f299b tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:02.570818 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a50ec56b-f9eb-459e-84af-7548216f299b tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:02.571428 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a50ec56b-f9eb-459e-84af-7548216f299b tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:02.571910 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a50ec56b-f9eb-459e-84af-7548216f299b tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:02.739940 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a50ec56b-f9eb-459e-84af-7548216f299b tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:02.751684 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a50ec56b-f9eb-459e-84af-7548216f299b tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1555 microversion: 2.1 time: 0.193757 Oct 01 04:19:02.757826 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 90/164] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:02 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1555 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:03.110821 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-20d36f63-e6e2-40d9-baaa-9e5182e80763 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:03.111431 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-20d36f63-e6e2-40d9-baaa-9e5182e80763 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:03.117835 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20d36f63-e6e2-40d9-baaa-9e5182e80763 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:03.118231 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20d36f63-e6e2-40d9-baaa-9e5182e80763 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:03.118662 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20d36f63-e6e2-40d9-baaa-9e5182e80763 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:03.119374 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20d36f63-e6e2-40d9-baaa-9e5182e80763 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:03.119822 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20d36f63-e6e2-40d9-baaa-9e5182e80763 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:03.120244 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20d36f63-e6e2-40d9-baaa-9e5182e80763 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:03.262338 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-20d36f63-e6e2-40d9-baaa-9e5182e80763 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:03.277042 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-20d36f63-e6e2-40d9-baaa-9e5182e80763 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.170667 Oct 01 04:19:03.277707 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 75/165] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:03 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:03.776180 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7284f3b8-6b43-4492-b641-e835f8e4fc66 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:03.776880 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7284f3b8-6b43-4492-b641-e835f8e4fc66 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:03.783707 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7284f3b8-6b43-4492-b641-e835f8e4fc66 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:03.784191 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7284f3b8-6b43-4492-b641-e835f8e4fc66 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:03.784618 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7284f3b8-6b43-4492-b641-e835f8e4fc66 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:03.785331 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7284f3b8-6b43-4492-b641-e835f8e4fc66 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:03.785786 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7284f3b8-6b43-4492-b641-e835f8e4fc66 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:03.786209 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7284f3b8-6b43-4492-b641-e835f8e4fc66 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:03.916551 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7284f3b8-6b43-4492-b641-e835f8e4fc66 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:03.925375 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7284f3b8-6b43-4492-b641-e835f8e4fc66 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1555 microversion: 2.1 time: 0.153642 Oct 01 04:19:03.925945 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 91/166] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:03 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:04.303514 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-949d5635-0077-41b0-a29d-a5615b2685db tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:04.304337 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-949d5635-0077-41b0-a29d-a5615b2685db tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:04.312302 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-949d5635-0077-41b0-a29d-a5615b2685db tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:04.312788 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-949d5635-0077-41b0-a29d-a5615b2685db tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:04.313244 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-949d5635-0077-41b0-a29d-a5615b2685db tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:04.313940 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-949d5635-0077-41b0-a29d-a5615b2685db tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:04.314418 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-949d5635-0077-41b0-a29d-a5615b2685db tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:04.314950 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-949d5635-0077-41b0-a29d-a5615b2685db tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:04.454476 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-949d5635-0077-41b0-a29d-a5615b2685db tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:04.462828 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-949d5635-0077-41b0-a29d-a5615b2685db tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.165110 Oct 01 04:19:04.463425 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 76/167] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:04 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:04.952097 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-157b7fb3-80e6-4746-95f7-8a4c10e06af9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:04.952636 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-157b7fb3-80e6-4746-95f7-8a4c10e06af9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:04.958636 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-157b7fb3-80e6-4746-95f7-8a4c10e06af9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:04.959120 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-157b7fb3-80e6-4746-95f7-8a4c10e06af9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:04.959555 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-157b7fb3-80e6-4746-95f7-8a4c10e06af9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:04.960244 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-157b7fb3-80e6-4746-95f7-8a4c10e06af9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:04.960704 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-157b7fb3-80e6-4746-95f7-8a4c10e06af9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:04.961162 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-157b7fb3-80e6-4746-95f7-8a4c10e06af9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:05.091123 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-157b7fb3-80e6-4746-95f7-8a4c10e06af9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:05.099906 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-157b7fb3-80e6-4746-95f7-8a4c10e06af9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1555 microversion: 2.1 time: 0.152441 Oct 01 04:19:05.100467 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 92/168] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:04 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:05.487273 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4f980aad-2a9f-41a0-b3ea-3b5671aa6a26 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:05.488006 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4f980aad-2a9f-41a0-b3ea-3b5671aa6a26 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:05.494701 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f980aad-2a9f-41a0-b3ea-3b5671aa6a26 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:05.495197 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f980aad-2a9f-41a0-b3ea-3b5671aa6a26 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:05.495614 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f980aad-2a9f-41a0-b3ea-3b5671aa6a26 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:05.496327 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f980aad-2a9f-41a0-b3ea-3b5671aa6a26 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:05.496791 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f980aad-2a9f-41a0-b3ea-3b5671aa6a26 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:05.497263 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f980aad-2a9f-41a0-b3ea-3b5671aa6a26 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:05.647621 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-4f980aad-2a9f-41a0-b3ea-3b5671aa6a26 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:05.663666 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4f980aad-2a9f-41a0-b3ea-3b5671aa6a26 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.179703 Oct 01 04:19:05.671098 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 77/169] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:05 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:06.123862 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a67734e2-162d-4203-86a1-8337c51000d5 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:06.124822 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a67734e2-162d-4203-86a1-8337c51000d5 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:06.134656 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a67734e2-162d-4203-86a1-8337c51000d5 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:06.135563 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a67734e2-162d-4203-86a1-8337c51000d5 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:06.136815 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a67734e2-162d-4203-86a1-8337c51000d5 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:06.138860 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a67734e2-162d-4203-86a1-8337c51000d5 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:06.140029 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a67734e2-162d-4203-86a1-8337c51000d5 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:06.141075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a67734e2-162d-4203-86a1-8337c51000d5 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:06.318105 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a67734e2-162d-4203-86a1-8337c51000d5 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:06.328803 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a67734e2-162d-4203-86a1-8337c51000d5 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1555 microversion: 2.1 time: 0.209588 Oct 01 04:19:06.329503 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 93/170] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:06 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1555 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:06.687359 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6623793a-7c75-47d2-8a0a-e6e4236e1dc1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:06.688228 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6623793a-7c75-47d2-8a0a-e6e4236e1dc1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:06.700261 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6623793a-7c75-47d2-8a0a-e6e4236e1dc1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:06.703925 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6623793a-7c75-47d2-8a0a-e6e4236e1dc1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:06.705613 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6623793a-7c75-47d2-8a0a-e6e4236e1dc1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:06.707669 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6623793a-7c75-47d2-8a0a-e6e4236e1dc1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:06.709054 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6623793a-7c75-47d2-8a0a-e6e4236e1dc1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:06.709760 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6623793a-7c75-47d2-8a0a-e6e4236e1dc1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:06.898452 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-0d010796-ebc6-419f-892a-12fde8d1793f req-5ce19767-063d-424c-8ff2-39cb4c13eb9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dfb3a74-410c-431c-bbc1-4f8f6489b924", "name": "network-vif-deleted", "tag": "03e60013-3f85-4d23-979a-41de21fce50c"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:19:06.922030 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0d010796-ebc6-419f-892a-12fde8d1793f req-5ce19767-063d-424c-8ff2-39cb4c13eb9e service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:06.922509 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0d010796-ebc6-419f-892a-12fde8d1793f req-5ce19767-063d-424c-8ff2-39cb4c13eb9e service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:06.922938 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0d010796-ebc6-419f-892a-12fde8d1793f req-5ce19767-063d-424c-8ff2-39cb4c13eb9e service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:06.990208 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-0d010796-ebc6-419f-892a-12fde8d1793f req-5ce19767-063d-424c-8ff2-39cb4c13eb9e service nova] Creating event network-vif-deleted:03e60013-3f85-4d23-979a-41de21fce50c for instance 7dfb3a74-410c-431c-bbc1-4f8f6489b924 on hv-cinder-86004 Oct 01 04:19:07.000338 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-0d010796-ebc6-419f-892a-12fde8d1793f req-5ce19767-063d-424c-8ff2-39cb4c13eb9e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104873 Oct 01 04:19:07.001790 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 94/171] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:19:07.024159 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-6623793a-7c75-47d2-8a0a-e6e4236e1dc1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:07.032413 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6623793a-7c75-47d2-8a0a-e6e4236e1dc1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.349411 Oct 01 04:19:07.038886 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 78/172] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:06 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:07.352502 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d4303f31-ca84-49aa-870d-ebae97b2f402 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:07.353473 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d4303f31-ca84-49aa-870d-ebae97b2f402 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:07.362128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4303f31-ca84-49aa-870d-ebae97b2f402 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:07.362905 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4303f31-ca84-49aa-870d-ebae97b2f402 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:07.363739 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4303f31-ca84-49aa-870d-ebae97b2f402 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:07.364488 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4303f31-ca84-49aa-870d-ebae97b2f402 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:07.365153 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4303f31-ca84-49aa-870d-ebae97b2f402 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:07.365784 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4303f31-ca84-49aa-870d-ebae97b2f402 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:07.459587 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d4303f31-ca84-49aa-870d-ebae97b2f402 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfcc0e7f557e4334a808f5dfaffe93db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b321c355e94b8496955f09f547f561', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:07.468379 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d4303f31-ca84-49aa-870d-ebae97b2f402 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 200 len: 1346 microversion: 2.1 time: 0.119788 Oct 01 04:19:07.469156 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 95/173] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:07 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 1346 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:08.055800 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-003cc699-87bb-40bc-8e66-28bfffb9581a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:08.056421 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-003cc699-87bb-40bc-8e66-28bfffb9581a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:08.063346 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-003cc699-87bb-40bc-8e66-28bfffb9581a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:08.063839 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-003cc699-87bb-40bc-8e66-28bfffb9581a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:08.064285 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-003cc699-87bb-40bc-8e66-28bfffb9581a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:08.065058 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-003cc699-87bb-40bc-8e66-28bfffb9581a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:08.065503 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-003cc699-87bb-40bc-8e66-28bfffb9581a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:08.065980 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-003cc699-87bb-40bc-8e66-28bfffb9581a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:08.442979 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-003cc699-87bb-40bc-8e66-28bfffb9581a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:08.451370 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-003cc699-87bb-40bc-8e66-28bfffb9581a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.399472 Oct 01 04:19:08.452074 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 79/174] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:08 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:08.492996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-90e2e67f-5ae8-400f-a09d-c1d016d91e17 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:08.493646 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-90e2e67f-5ae8-400f-a09d-c1d016d91e17 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:08.500086 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90e2e67f-5ae8-400f-a09d-c1d016d91e17 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:08.500577 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90e2e67f-5ae8-400f-a09d-c1d016d91e17 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:08.501052 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90e2e67f-5ae8-400f-a09d-c1d016d91e17 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:08.501768 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90e2e67f-5ae8-400f-a09d-c1d016d91e17 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:08.502232 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90e2e67f-5ae8-400f-a09d-c1d016d91e17 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:08.502662 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-90e2e67f-5ae8-400f-a09d-c1d016d91e17 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:08.520161 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-90e2e67f-5ae8-400f-a09d-c1d016d91e17 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] HTTP exception thrown: Instance 7dfb3a74-410c-431c-bbc1-4f8f6489b924 could not be found. Oct 01 04:19:08.524855 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-90e2e67f-5ae8-400f-a09d-c1d016d91e17 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Request method failure captured: Oct 01 04:19:08.524855 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 HTTP/1.1 Oct 01 04:19:08.524855 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:19:08.524855 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:19:08.524855 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:19:08.524855 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 0 Oct 01 04:19:08.524855 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:19:08.524855 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:19:08.524855 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:19:08.524855 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:19:08.524855 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN79zoYt4Qki9UEzK7FrkBErb9_fMGEsKcjOf-QXR_7dk6qi8ufG92FR3tH72pj8kSYeJRg3KWgnSw__FoICpY8TimHoiGGLMfQAIOlvKL2Vf9P1sG2fwHBIZmLXS2Rodp-2hqP2wW0O-H8eHXHd6Q33muIopbLRpoZzJv9GYLdetgV4 Oct 01 04:19:08.524855 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:19:08.524855 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:19:08.524855 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:19:08.524855 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:19:08.524855 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:19:08.524855 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:19:08.524855 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: c1b321c355e94b8496955f09f547f561 Oct 01 04:19:08.524855 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-DeleteServersTestJSON-414772603 Oct 01 04:19:08.524855 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:19:08.524855 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:19:08.526572 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c1b321c355e94b8496955f09f547f561"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c1b321c355e94b8496955f09f547f561"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c1b321c355e94b8496955f09f547f561"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c1b321c355e94b8496955f09f547f561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:19:08.526572 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-DeleteServersTestJSON-414772603 Oct 01 04:19:08.526572 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: c1b321c355e94b8496955f09f547f561 Oct 01 04:19:08.526572 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-DeleteServersTestJSON-414772603 Oct 01 04:19:08.526572 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-DeleteServersTestJSON-414772603-project Oct 01 04:19:08.526572 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:19:08.526572 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:19:08.526572 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: bfcc0e7f557e4334a808f5dfaffe93db Oct 01 04:19:08.526572 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-DeleteServersTestJSON-414772603-project Oct 01 04:19:08.526572 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: > Oct 01 04:19:08.526572 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Instance 7dfb3a74-410c-431c-bbc1-4f8f6489b924 could not be found. Oct 01 04:19:08.526572 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'id': '7dfb3a74-410c-431c-bbc1-4f8f6489b924'} Oct 01 04:19:08.527371 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:19:08.527371 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:19:08.527371 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:19:08.527371 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:19:08.527371 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:19:08.527371 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:19:08.527371 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:19:08.527371 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:19:08.527371 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:19:08.527371 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:19:08.527371 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dfb3a74-410c-431c-bbc1-4f8f6489b924 could not be found. Oct 01 04:19:08.527371 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:19:08.527371 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:19:08.527371 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:19:08.527371 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:19:08.527371 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:19:08.527371 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:19:08.527371 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:19:08.527371 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:19:08.527371 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:19:08.529497 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:19:08.529497 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:19:08.529497 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:19:08.529497 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:19:08.529497 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:19:08.529497 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:19:08.529497 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:19:08.529497 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dfb3a74-410c-431c-bbc1-4f8f6489b924 could not be found. Oct 01 04:19:08.529497 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:19:08.529497 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:19:08.529497 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:19:08.529497 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:19:08.529497 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:19:08.529497 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:19:08.529497 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:19:08.529497 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:19:08.529497 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dfb3a74-410c-431c-bbc1-4f8f6489b924 could not be found. Oct 01 04:19:08.529497 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:19:08.530682 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-90e2e67f-5ae8-400f-a09d-c1d016d91e17 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Returning 404 to user: Instance 7dfb3a74-410c-431c-bbc1-4f8f6489b924 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:19:08.530682 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-90e2e67f-5ae8-400f-a09d-c1d016d91e17 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 404 len: 111 microversion: 2.1 time: 0.037591 Oct 01 04:19:08.530682 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 96/175] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:08 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:19:08.650576 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1d63378e-6359-4142-a062-fd2bdf2fb8c9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:08.655541 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1d63378e-6359-4142-a062-fd2bdf2fb8c9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:08.666306 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d63378e-6359-4142-a062-fd2bdf2fb8c9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:08.667360 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d63378e-6359-4142-a062-fd2bdf2fb8c9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:08.668314 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d63378e-6359-4142-a062-fd2bdf2fb8c9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:08.670014 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d63378e-6359-4142-a062-fd2bdf2fb8c9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:08.671102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d63378e-6359-4142-a062-fd2bdf2fb8c9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:08.671871 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d63378e-6359-4142-a062-fd2bdf2fb8c9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:08.697900 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-1d63378e-6359-4142-a062-fd2bdf2fb8c9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] HTTP exception thrown: Instance 7dfb3a74-410c-431c-bbc1-4f8f6489b924 could not be found. Oct 01 04:19:08.706102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1d63378e-6359-4142-a062-fd2bdf2fb8c9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Request method failure captured: Oct 01 04:19:08.706102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924/os-volume_attachments HTTP/1.1 Oct 01 04:19:08.706102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept: application/json Oct 01 04:19:08.706102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept-Encoding: identity Oct 01 04:19:08.706102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Connection: close Oct 01 04:19:08.706102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Length: 0 Oct 01 04:19:08.706102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Type: application/json Oct 01 04:19:08.706102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Host: 10.222.0.26 Oct 01 04:19:08.706102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 01 04:19:08.706102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 01 04:19:08.706102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjN79zoYt4Qki9UEzK7FrkBErb9_fMGEsKcjOf-QXR_7dk6qi8ufG92FR3tH72pj8kSYeJRg3KWgnSw__FoICpY8TimHoiGGLMfQAIOlvKL2Vf9P1sG2fwHBIZmLXS2Rodp-2hqP2wW0O-H8eHXHd6Q33muIopbLRpoZzJv9GYLdetgV4 Oct 01 04:19:08.706102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Id: None Oct 01 04:19:08.706102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Name: None Oct 01 04:19:08.706102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 01 04:19:08.706102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 01 04:19:08.706102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 01 04:19:08.706102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 01 04:19:08.706102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Id: c1b321c355e94b8496955f09f547f561 Oct 01 04:19:08.706102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Name: tempest-DeleteServersTestJSON-414772603 Oct 01 04:19:08.706102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Role: reader,member Oct 01 04:19:08.706102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Roles: reader,member Oct 01 04:19:08.707518 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c1b321c355e94b8496955f09f547f561"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c1b321c355e94b8496955f09f547f561"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c1b321c355e94b8496955f09f547f561"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c1b321c355e94b8496955f09f547f561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:19:08.707518 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant: tempest-DeleteServersTestJSON-414772603 Oct 01 04:19:08.707518 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Id: c1b321c355e94b8496955f09f547f561 Oct 01 04:19:08.707518 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Name: tempest-DeleteServersTestJSON-414772603 Oct 01 04:19:08.707518 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User: tempest-DeleteServersTestJSON-414772603-project Oct 01 04:19:08.707518 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 01 04:19:08.707518 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 01 04:19:08.707518 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Id: bfcc0e7f557e4334a808f5dfaffe93db Oct 01 04:19:08.707518 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Name: tempest-DeleteServersTestJSON-414772603-project Oct 01 04:19:08.707518 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: method: > Oct 01 04:19:08.707518 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: exception: Instance 7dfb3a74-410c-431c-bbc1-4f8f6489b924 could not be found. Oct 01 04:19:08.707518 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: action_args: {'server_id': '7dfb3a74-410c-431c-bbc1-4f8f6489b924'} Oct 01 04:19:08.708185 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:19:08.708185 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:19:08.708185 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:19:08.708185 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:19:08.708185 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:19:08.708185 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:19:08.708185 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:19:08.708185 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:19:08.708185 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:19:08.708185 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:19:08.708185 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dfb3a74-410c-431c-bbc1-4f8f6489b924 could not be found. Oct 01 04:19:08.708185 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:19:08.708185 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:19:08.708185 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:19:08.708185 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:19:08.708185 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:19:08.708185 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:19:08.708185 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:19:08.708185 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:19:08.708185 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:19:08.709300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:19:08.709300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 01 04:19:08.709300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 04:19:08.709300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 01 04:19:08.709300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 04:19:08.709300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 01 04:19:08.709300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 01 04:19:08.709300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:19:08.709300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:19:08.709300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dfb3a74-410c-431c-bbc1-4f8f6489b924 could not be found. Oct 01 04:19:08.709300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:19:08.709300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:19:08.709300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:19:08.709300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:19:08.709300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:19:08.709300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:19:08.709300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:19:08.709300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:19:08.709300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dfb3a74-410c-431c-bbc1-4f8f6489b924 could not be found. Oct 01 04:19:08.709300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:19:08.710409 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1d63378e-6359-4142-a062-fd2bdf2fb8c9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Returning 404 to user: Instance 7dfb3a74-410c-431c-bbc1-4f8f6489b924 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:19:08.710409 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1d63378e-6359-4142-a062-fd2bdf2fb8c9 tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.066491 Oct 01 04:19:08.710409 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 80/176] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 1 04:19:08 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924/os-volume_attachments => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:19:09.478844 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9e87b4ed-449c-4777-8812-78bf896cf323 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:09.479678 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9e87b4ed-449c-4777-8812-78bf896cf323 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:09.488714 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e87b4ed-449c-4777-8812-78bf896cf323 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:09.489249 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e87b4ed-449c-4777-8812-78bf896cf323 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:09.491935 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e87b4ed-449c-4777-8812-78bf896cf323 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:09.492633 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e87b4ed-449c-4777-8812-78bf896cf323 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:09.494594 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e87b4ed-449c-4777-8812-78bf896cf323 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:09.495805 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9e87b4ed-449c-4777-8812-78bf896cf323 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:09.724968 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-9e87b4ed-449c-4777-8812-78bf896cf323 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:09.739824 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9e87b4ed-449c-4777-8812-78bf896cf323 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.261979 Oct 01 04:19:09.739824 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 97/177] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:09 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:09.986182 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2cc5270f-e4ce-469b-bfcb-4cd46337aedf tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:09.986976 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2cc5270f-e4ce-469b-bfcb-4cd46337aedf tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:09.993757 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cc5270f-e4ce-469b-bfcb-4cd46337aedf tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:09.994361 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cc5270f-e4ce-469b-bfcb-4cd46337aedf tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:09.994861 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cc5270f-e4ce-469b-bfcb-4cd46337aedf tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:09.995725 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cc5270f-e4ce-469b-bfcb-4cd46337aedf tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:09.996465 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cc5270f-e4ce-469b-bfcb-4cd46337aedf tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:09.997002 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2cc5270f-e4ce-469b-bfcb-4cd46337aedf tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:10.015126 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-2cc5270f-e4ce-469b-bfcb-4cd46337aedf tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] HTTP exception thrown: Instance 7dfb3a74-410c-431c-bbc1-4f8f6489b924 could not be found. Oct 01 04:19:10.031987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2cc5270f-e4ce-469b-bfcb-4cd46337aedf tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Request method failure captured: Oct 01 04:19:10.031987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 HTTP/1.1 Oct 01 04:19:10.031987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept: application/json Oct 01 04:19:10.031987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept-Encoding: identity Oct 01 04:19:10.031987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Connection: close Oct 01 04:19:10.031987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Length: 0 Oct 01 04:19:10.031987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Type: application/json Oct 01 04:19:10.031987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Host: 10.222.0.26 Oct 01 04:19:10.031987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 01 04:19:10.031987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 01 04:19:10.031987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjN79zoYt4Qki9UEzK7FrkBErb9_fMGEsKcjOf-QXR_7dk6qi8ufG92FR3tH72pj8kSYeJRg3KWgnSw__FoICpY8TimHoiGGLMfQAIOlvKL2Vf9P1sG2fwHBIZmLXS2Rodp-2hqP2wW0O-H8eHXHd6Q33muIopbLRpoZzJv9GYLdetgV4 Oct 01 04:19:10.031987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Id: None Oct 01 04:19:10.031987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Name: None Oct 01 04:19:10.031987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 01 04:19:10.031987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 01 04:19:10.031987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 01 04:19:10.031987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 01 04:19:10.031987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Id: c1b321c355e94b8496955f09f547f561 Oct 01 04:19:10.031987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Name: tempest-DeleteServersTestJSON-414772603 Oct 01 04:19:10.031987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Role: reader,member Oct 01 04:19:10.031987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Roles: reader,member Oct 01 04:19:10.033489 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c1b321c355e94b8496955f09f547f561"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c1b321c355e94b8496955f09f547f561"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c1b321c355e94b8496955f09f547f561"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c1b321c355e94b8496955f09f547f561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:19:10.033489 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant: tempest-DeleteServersTestJSON-414772603 Oct 01 04:19:10.033489 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Id: c1b321c355e94b8496955f09f547f561 Oct 01 04:19:10.033489 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Name: tempest-DeleteServersTestJSON-414772603 Oct 01 04:19:10.033489 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User: tempest-DeleteServersTestJSON-414772603-project Oct 01 04:19:10.033489 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 01 04:19:10.033489 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 01 04:19:10.033489 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Id: bfcc0e7f557e4334a808f5dfaffe93db Oct 01 04:19:10.033489 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Name: tempest-DeleteServersTestJSON-414772603-project Oct 01 04:19:10.033489 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: method: > Oct 01 04:19:10.033489 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: exception: Instance 7dfb3a74-410c-431c-bbc1-4f8f6489b924 could not be found. Oct 01 04:19:10.033489 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: action_args: {'id': '7dfb3a74-410c-431c-bbc1-4f8f6489b924'} Oct 01 04:19:10.034290 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:19:10.034290 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:19:10.034290 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:19:10.034290 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:19:10.034290 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:19:10.034290 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:19:10.034290 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:19:10.034290 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:19:10.034290 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:19:10.034290 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:19:10.034290 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dfb3a74-410c-431c-bbc1-4f8f6489b924 could not be found. Oct 01 04:19:10.034290 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:19:10.034290 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:19:10.034290 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:19:10.034290 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:19:10.034290 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:19:10.034290 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:19:10.034290 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:19:10.034290 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:19:10.034290 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:19:10.035487 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:19:10.035487 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 04:19:10.035487 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 04:19:10.035487 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 04:19:10.035487 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 04:19:10.035487 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:19:10.035487 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:19:10.035487 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:19:10.035487 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:19:10.035487 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dfb3a74-410c-431c-bbc1-4f8f6489b924 could not be found. Oct 01 04:19:10.035487 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:19:10.035487 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:19:10.035487 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:19:10.035487 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:19:10.035487 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:19:10.035487 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:19:10.035487 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:19:10.035487 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:19:10.035487 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dfb3a74-410c-431c-bbc1-4f8f6489b924 could not be found. Oct 01 04:19:10.035487 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:19:10.036765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2cc5270f-e4ce-469b-bfcb-4cd46337aedf tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Returning 404 to user: Instance 7dfb3a74-410c-431c-bbc1-4f8f6489b924 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:19:10.036765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2cc5270f-e4ce-469b-bfcb-4cd46337aedf tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 404 len: 111 microversion: 2.1 time: 0.052835 Oct 01 04:19:10.036765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 81/178] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 1 04:19:09 2022] DELETE /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:19:10.043658 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b1884416-7f06-4f9f-88aa-67ea985089fd tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:10.044843 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b1884416-7f06-4f9f-88aa-67ea985089fd tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] [instance: 7dfb3a74-410c-431c-bbc1-4f8f6489b924] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:10.051077 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1884416-7f06-4f9f-88aa-67ea985089fd tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:10.051652 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1884416-7f06-4f9f-88aa-67ea985089fd tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:10.052143 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1884416-7f06-4f9f-88aa-67ea985089fd tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:10.052857 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1884416-7f06-4f9f-88aa-67ea985089fd tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:10.053351 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1884416-7f06-4f9f-88aa-67ea985089fd tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:10.053780 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1884416-7f06-4f9f-88aa-67ea985089fd tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:10.068488 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-b1884416-7f06-4f9f-88aa-67ea985089fd tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] HTTP exception thrown: Instance 7dfb3a74-410c-431c-bbc1-4f8f6489b924 could not be found. Oct 01 04:19:10.070033 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b1884416-7f06-4f9f-88aa-67ea985089fd tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Request method failure captured: Oct 01 04:19:10.070033 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 HTTP/1.1 Oct 01 04:19:10.070033 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:19:10.070033 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:19:10.070033 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:19:10.070033 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 0 Oct 01 04:19:10.070033 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:19:10.070033 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:19:10.070033 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:19:10.070033 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:19:10.070033 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN79zoYt4Qki9UEzK7FrkBErb9_fMGEsKcjOf-QXR_7dk6qi8ufG92FR3tH72pj8kSYeJRg3KWgnSw__FoICpY8TimHoiGGLMfQAIOlvKL2Vf9P1sG2fwHBIZmLXS2Rodp-2hqP2wW0O-H8eHXHd6Q33muIopbLRpoZzJv9GYLdetgV4 Oct 01 04:19:10.070033 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:19:10.070033 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:19:10.070033 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:19:10.070033 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:19:10.070033 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:19:10.070033 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:19:10.070033 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: c1b321c355e94b8496955f09f547f561 Oct 01 04:19:10.070033 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-DeleteServersTestJSON-414772603 Oct 01 04:19:10.070033 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:19:10.070033 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:19:10.071376 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c1b321c355e94b8496955f09f547f561"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c1b321c355e94b8496955f09f547f561"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c1b321c355e94b8496955f09f547f561"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c1b321c355e94b8496955f09f547f561"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:19:10.071376 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-DeleteServersTestJSON-414772603 Oct 01 04:19:10.071376 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: c1b321c355e94b8496955f09f547f561 Oct 01 04:19:10.071376 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-DeleteServersTestJSON-414772603 Oct 01 04:19:10.071376 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-DeleteServersTestJSON-414772603-project Oct 01 04:19:10.071376 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:19:10.071376 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:19:10.071376 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: bfcc0e7f557e4334a808f5dfaffe93db Oct 01 04:19:10.071376 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-DeleteServersTestJSON-414772603-project Oct 01 04:19:10.071376 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: > Oct 01 04:19:10.071376 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Instance 7dfb3a74-410c-431c-bbc1-4f8f6489b924 could not be found. Oct 01 04:19:10.071376 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'id': '7dfb3a74-410c-431c-bbc1-4f8f6489b924'} Oct 01 04:19:10.072027 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:19:10.072027 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:19:10.072027 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:19:10.072027 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:19:10.072027 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:19:10.072027 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:19:10.072027 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:19:10.072027 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:19:10.072027 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:19:10.072027 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:19:10.072027 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dfb3a74-410c-431c-bbc1-4f8f6489b924 could not be found. Oct 01 04:19:10.072027 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:19:10.072027 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:19:10.072027 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:19:10.072027 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:19:10.072027 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:19:10.072027 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:19:10.072027 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:19:10.072027 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:19:10.072027 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:19:10.073182 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:19:10.073182 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:19:10.073182 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:19:10.073182 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:19:10.073182 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:19:10.073182 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:19:10.073182 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:19:10.073182 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dfb3a74-410c-431c-bbc1-4f8f6489b924 could not be found. Oct 01 04:19:10.073182 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:19:10.073182 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:19:10.073182 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:19:10.073182 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:19:10.073182 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:19:10.073182 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:19:10.073182 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:19:10.073182 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:19:10.073182 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dfb3a74-410c-431c-bbc1-4f8f6489b924 could not be found. Oct 01 04:19:10.073182 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:19:10.074220 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b1884416-7f06-4f9f-88aa-67ea985089fd tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] Returning 404 to user: Instance 7dfb3a74-410c-431c-bbc1-4f8f6489b924 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:19:10.074220 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b1884416-7f06-4f9f-88aa-67ea985089fd tempest-DeleteServersTestJSON-414772603 tempest-DeleteServersTestJSON-414772603-project] 10.222.0.26 "GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924" status: 404 len: 111 microversion: 2.1 time: 0.032022 Oct 01 04:19:10.074220 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 98/179] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:10 2022] GET /compute/v2.1/servers/7dfb3a74-410c-431c-bbc1-4f8f6489b924 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:19:10.761852 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c35ee215-c601-4684-aa28-3474e19f45b7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:10.763005 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c35ee215-c601-4684-aa28-3474e19f45b7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:10.770443 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c35ee215-c601-4684-aa28-3474e19f45b7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:10.771066 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c35ee215-c601-4684-aa28-3474e19f45b7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:10.771448 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c35ee215-c601-4684-aa28-3474e19f45b7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:10.772251 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c35ee215-c601-4684-aa28-3474e19f45b7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:10.772667 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c35ee215-c601-4684-aa28-3474e19f45b7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:10.773131 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c35ee215-c601-4684-aa28-3474e19f45b7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:10.926284 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c35ee215-c601-4684-aa28-3474e19f45b7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:10.935878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c35ee215-c601-4684-aa28-3474e19f45b7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.178807 Oct 01 04:19:10.936467 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 82/180] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:10 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:11.959182 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0dac619d-0795-48a4-b04c-9b8a174a5b98 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:11.959867 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0dac619d-0795-48a4-b04c-9b8a174a5b98 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:11.968666 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0dac619d-0795-48a4-b04c-9b8a174a5b98 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:11.969446 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0dac619d-0795-48a4-b04c-9b8a174a5b98 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:11.970030 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0dac619d-0795-48a4-b04c-9b8a174a5b98 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:11.972866 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0dac619d-0795-48a4-b04c-9b8a174a5b98 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:11.973513 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0dac619d-0795-48a4-b04c-9b8a174a5b98 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:11.974095 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0dac619d-0795-48a4-b04c-9b8a174a5b98 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:12.236228 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0dac619d-0795-48a4-b04c-9b8a174a5b98 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:12.246059 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0dac619d-0795-48a4-b04c-9b8a174a5b98 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.290601 Oct 01 04:19:12.247731 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 99/181] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:11 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:13.272954 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1d77aa3c-1708-4124-b9f5-dba838a6bf78 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:13.273579 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1d77aa3c-1708-4124-b9f5-dba838a6bf78 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:13.282477 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d77aa3c-1708-4124-b9f5-dba838a6bf78 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:13.283189 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d77aa3c-1708-4124-b9f5-dba838a6bf78 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:13.283817 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d77aa3c-1708-4124-b9f5-dba838a6bf78 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:13.284689 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d77aa3c-1708-4124-b9f5-dba838a6bf78 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:13.285451 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d77aa3c-1708-4124-b9f5-dba838a6bf78 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:13.286873 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d77aa3c-1708-4124-b9f5-dba838a6bf78 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:13.744560 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-1d77aa3c-1708-4124-b9f5-dba838a6bf78 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:13.769800 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1d77aa3c-1708-4124-b9f5-dba838a6bf78 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.490925 Oct 01 04:19:13.769800 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 83/182] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:13 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:14.785959 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-35ea375b-2074-4ec5-bea2-4c3a68265161 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:14.786585 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-35ea375b-2074-4ec5-bea2-4c3a68265161 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:14.793142 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35ea375b-2074-4ec5-bea2-4c3a68265161 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:14.793709 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35ea375b-2074-4ec5-bea2-4c3a68265161 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:14.794420 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35ea375b-2074-4ec5-bea2-4c3a68265161 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:14.795468 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35ea375b-2074-4ec5-bea2-4c3a68265161 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:14.795987 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35ea375b-2074-4ec5-bea2-4c3a68265161 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:14.796498 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-35ea375b-2074-4ec5-bea2-4c3a68265161 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:14.929924 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-35ea375b-2074-4ec5-bea2-4c3a68265161 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:14.937831 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-35ea375b-2074-4ec5-bea2-4c3a68265161 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.155756 Oct 01 04:19:14.938391 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 100/183] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:14 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:15.961322 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-679c92cb-4371-48fc-a73a-7f85ec9c3df4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:15.962215 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-679c92cb-4371-48fc-a73a-7f85ec9c3df4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:15.969164 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-679c92cb-4371-48fc-a73a-7f85ec9c3df4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:15.969652 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-679c92cb-4371-48fc-a73a-7f85ec9c3df4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:15.970084 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-679c92cb-4371-48fc-a73a-7f85ec9c3df4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:15.970804 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-679c92cb-4371-48fc-a73a-7f85ec9c3df4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:15.971257 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-679c92cb-4371-48fc-a73a-7f85ec9c3df4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:15.971678 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-679c92cb-4371-48fc-a73a-7f85ec9c3df4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:16.119370 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-679c92cb-4371-48fc-a73a-7f85ec9c3df4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:16.129700 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-679c92cb-4371-48fc-a73a-7f85ec9c3df4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.172418 Oct 01 04:19:16.130442 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 84/184] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:15 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:17.154559 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bb4c6bbc-b312-47dd-8f69-c080d4b64f1d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:17.155170 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bb4c6bbc-b312-47dd-8f69-c080d4b64f1d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:17.161723 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb4c6bbc-b312-47dd-8f69-c080d4b64f1d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:17.162813 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb4c6bbc-b312-47dd-8f69-c080d4b64f1d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:17.163266 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb4c6bbc-b312-47dd-8f69-c080d4b64f1d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:17.164139 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb4c6bbc-b312-47dd-8f69-c080d4b64f1d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:17.164798 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb4c6bbc-b312-47dd-8f69-c080d4b64f1d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:17.165272 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb4c6bbc-b312-47dd-8f69-c080d4b64f1d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:17.316370 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-bb4c6bbc-b312-47dd-8f69-c080d4b64f1d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:17.324491 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bb4c6bbc-b312-47dd-8f69-c080d4b64f1d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.174832 Oct 01 04:19:17.325203 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 101/185] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:17 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:18.349914 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f632977d-5c1b-43cd-b6ce-ad91027f7e34 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:18.351050 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f632977d-5c1b-43cd-b6ce-ad91027f7e34 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:18.358008 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f632977d-5c1b-43cd-b6ce-ad91027f7e34 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:18.358490 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f632977d-5c1b-43cd-b6ce-ad91027f7e34 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:18.358917 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f632977d-5c1b-43cd-b6ce-ad91027f7e34 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:18.359607 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f632977d-5c1b-43cd-b6ce-ad91027f7e34 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:18.360059 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f632977d-5c1b-43cd-b6ce-ad91027f7e34 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:18.360476 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f632977d-5c1b-43cd-b6ce-ad91027f7e34 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:18.506483 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-f632977d-5c1b-43cd-b6ce-ad91027f7e34 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:18.519513 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f632977d-5c1b-43cd-b6ce-ad91027f7e34 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.173256 Oct 01 04:19:18.520213 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 85/186] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:18 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:19.542783 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-07fd2d7b-7c81-472d-a755-faea4ef60825 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:19.543453 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-07fd2d7b-7c81-472d-a755-faea4ef60825 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:19.550154 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07fd2d7b-7c81-472d-a755-faea4ef60825 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:19.550676 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07fd2d7b-7c81-472d-a755-faea4ef60825 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:19.551417 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07fd2d7b-7c81-472d-a755-faea4ef60825 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:19.552098 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07fd2d7b-7c81-472d-a755-faea4ef60825 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:19.552660 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07fd2d7b-7c81-472d-a755-faea4ef60825 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:19.553274 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07fd2d7b-7c81-472d-a755-faea4ef60825 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:19.697700 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-07fd2d7b-7c81-472d-a755-faea4ef60825 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:19.705711 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-07fd2d7b-7c81-472d-a755-faea4ef60825 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.166914 Oct 01 04:19:19.706287 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 102/187] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:19 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:20.730402 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-19cd45ff-ae17-439e-be35-8b44dcbf37b0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:20.731041 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-19cd45ff-ae17-439e-be35-8b44dcbf37b0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:20.737959 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19cd45ff-ae17-439e-be35-8b44dcbf37b0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:20.738443 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19cd45ff-ae17-439e-be35-8b44dcbf37b0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:20.738873 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19cd45ff-ae17-439e-be35-8b44dcbf37b0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:20.739571 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19cd45ff-ae17-439e-be35-8b44dcbf37b0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:20.740030 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19cd45ff-ae17-439e-be35-8b44dcbf37b0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:20.740447 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-19cd45ff-ae17-439e-be35-8b44dcbf37b0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:20.877521 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-19cd45ff-ae17-439e-be35-8b44dcbf37b0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:20.885235 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-19cd45ff-ae17-439e-be35-8b44dcbf37b0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.159287 Oct 01 04:19:20.900456 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 86/188] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:20 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:21.907898 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bdc71dc0-c107-4300-a870-f133862c6808 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:21.908440 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bdc71dc0-c107-4300-a870-f133862c6808 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:21.914358 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bdc71dc0-c107-4300-a870-f133862c6808 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:21.914982 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bdc71dc0-c107-4300-a870-f133862c6808 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:21.915426 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bdc71dc0-c107-4300-a870-f133862c6808 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:21.916147 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bdc71dc0-c107-4300-a870-f133862c6808 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:21.916608 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bdc71dc0-c107-4300-a870-f133862c6808 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:21.917069 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bdc71dc0-c107-4300-a870-f133862c6808 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:22.044537 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-bdc71dc0-c107-4300-a870-f133862c6808 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:22.052206 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bdc71dc0-c107-4300-a870-f133862c6808 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.148229 Oct 01 04:19:22.052771 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 103/189] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:21 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:23.076063 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f35b6e0e-868b-4228-8568-abbd0694de22 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:23.076753 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f35b6e0e-868b-4228-8568-abbd0694de22 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:23.083342 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f35b6e0e-868b-4228-8568-abbd0694de22 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:23.083822 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f35b6e0e-868b-4228-8568-abbd0694de22 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:23.084257 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f35b6e0e-868b-4228-8568-abbd0694de22 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:23.084973 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f35b6e0e-868b-4228-8568-abbd0694de22 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:23.085430 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f35b6e0e-868b-4228-8568-abbd0694de22 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:23.085849 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f35b6e0e-868b-4228-8568-abbd0694de22 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:23.219796 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-f35b6e0e-868b-4228-8568-abbd0694de22 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:23.227384 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f35b6e0e-868b-4228-8568-abbd0694de22 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.155706 Oct 01 04:19:23.227939 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 87/190] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:23 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:24.249510 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6c29103b-9d07-4a9f-9639-432f16fb88f3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:24.250193 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6c29103b-9d07-4a9f-9639-432f16fb88f3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:24.252376 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:24.257971 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c29103b-9d07-4a9f-9639-432f16fb88f3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:24.258456 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c29103b-9d07-4a9f-9639-432f16fb88f3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:24.258905 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c29103b-9d07-4a9f-9639-432f16fb88f3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:24.259695 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c29103b-9d07-4a9f-9639-432f16fb88f3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:24.260145 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c29103b-9d07-4a9f-9639-432f16fb88f3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:24.260781 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6c29103b-9d07-4a9f-9639-432f16fb88f3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:24.392480 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-6c29103b-9d07-4a9f-9639-432f16fb88f3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:24.400034 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6c29103b-9d07-4a9f-9639-432f16fb88f3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.154814 Oct 01 04:19:24.400855 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 104/191] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:24 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:19:25.424230 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a87acfdf-9295-4074-94ca-728553e8088d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:25.424836 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a87acfdf-9295-4074-94ca-728553e8088d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:25.431316 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a87acfdf-9295-4074-94ca-728553e8088d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:25.431801 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a87acfdf-9295-4074-94ca-728553e8088d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:25.432233 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a87acfdf-9295-4074-94ca-728553e8088d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:25.433114 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a87acfdf-9295-4074-94ca-728553e8088d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:25.433574 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a87acfdf-9295-4074-94ca-728553e8088d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:25.433999 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a87acfdf-9295-4074-94ca-728553e8088d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:25.575921 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-a87acfdf-9295-4074-94ca-728553e8088d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:25.583649 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a87acfdf-9295-4074-94ca-728553e8088d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.163311 Oct 01 04:19:25.584211 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 88/192] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:25 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:19:26.608783 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-97407cbf-1576-49fb-a791-23e8b23c4d6d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:26.609676 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-97407cbf-1576-49fb-a791-23e8b23c4d6d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:26.619506 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97407cbf-1576-49fb-a791-23e8b23c4d6d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:26.620107 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97407cbf-1576-49fb-a791-23e8b23c4d6d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:26.620594 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97407cbf-1576-49fb-a791-23e8b23c4d6d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:26.621589 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97407cbf-1576-49fb-a791-23e8b23c4d6d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:26.622778 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97407cbf-1576-49fb-a791-23e8b23c4d6d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:26.623382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97407cbf-1576-49fb-a791-23e8b23c4d6d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:26.767846 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-97407cbf-1576-49fb-a791-23e8b23c4d6d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:26.775889 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-97407cbf-1576-49fb-a791-23e8b23c4d6d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.172431 Oct 01 04:19:26.776449 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 105/193] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:26 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:27.798396 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a08ff434-a4af-4415-9186-d31b286690d4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:27.798988 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a08ff434-a4af-4415-9186-d31b286690d4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:27.801409 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=38 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:27.806601 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a08ff434-a4af-4415-9186-d31b286690d4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:27.807084 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a08ff434-a4af-4415-9186-d31b286690d4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:27.807514 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a08ff434-a4af-4415-9186-d31b286690d4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:27.808194 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a08ff434-a4af-4415-9186-d31b286690d4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:27.808647 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a08ff434-a4af-4415-9186-d31b286690d4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:27.809614 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a08ff434-a4af-4415-9186-d31b286690d4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:27.940496 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-a08ff434-a4af-4415-9186-d31b286690d4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:27.948227 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a08ff434-a4af-4415-9186-d31b286690d4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.153665 Oct 01 04:19:27.948797 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 89/194] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:27 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:19:28.971385 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-52d10336-2b26-4bcb-82dc-e81c12c162f6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:28.972030 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-52d10336-2b26-4bcb-82dc-e81c12c162f6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:28.978010 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52d10336-2b26-4bcb-82dc-e81c12c162f6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:28.978495 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52d10336-2b26-4bcb-82dc-e81c12c162f6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:28.978936 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52d10336-2b26-4bcb-82dc-e81c12c162f6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:28.979628 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52d10336-2b26-4bcb-82dc-e81c12c162f6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:28.980087 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52d10336-2b26-4bcb-82dc-e81c12c162f6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:28.980547 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52d10336-2b26-4bcb-82dc-e81c12c162f6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:28.985305 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:29.112090 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-52d10336-2b26-4bcb-82dc-e81c12c162f6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:29.119939 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-52d10336-2b26-4bcb-82dc-e81c12c162f6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.152362 Oct 01 04:19:29.120489 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 106/195] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:28 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:30.143205 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d01147d7-d408-4b8b-94b6-8fdf27478a65 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:30.143817 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d01147d7-d408-4b8b-94b6-8fdf27478a65 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:30.150221 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d01147d7-d408-4b8b-94b6-8fdf27478a65 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:30.150965 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d01147d7-d408-4b8b-94b6-8fdf27478a65 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:30.151403 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d01147d7-d408-4b8b-94b6-8fdf27478a65 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:30.152088 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d01147d7-d408-4b8b-94b6-8fdf27478a65 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:30.152545 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d01147d7-d408-4b8b-94b6-8fdf27478a65 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:30.153086 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d01147d7-d408-4b8b-94b6-8fdf27478a65 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:30.288062 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-d01147d7-d408-4b8b-94b6-8fdf27478a65 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:30.296215 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d01147d7-d408-4b8b-94b6-8fdf27478a65 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.156759 Oct 01 04:19:30.296774 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 90/196] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:30 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:31.319475 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-582a1b88-0987-47ee-8f78-60eac790af24 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:31.320229 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-582a1b88-0987-47ee-8f78-60eac790af24 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:31.327329 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-582a1b88-0987-47ee-8f78-60eac790af24 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:31.328078 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-582a1b88-0987-47ee-8f78-60eac790af24 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:31.328710 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-582a1b88-0987-47ee-8f78-60eac790af24 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:31.329875 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-582a1b88-0987-47ee-8f78-60eac790af24 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:31.330506 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-582a1b88-0987-47ee-8f78-60eac790af24 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:31.330971 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-582a1b88-0987-47ee-8f78-60eac790af24 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:31.489629 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-582a1b88-0987-47ee-8f78-60eac790af24 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:31.501930 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-582a1b88-0987-47ee-8f78-60eac790af24 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.186070 Oct 01 04:19:31.514131 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 107/197] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:31 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:32.525935 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6f677ff9-710b-4f40-9ab3-740e74303494 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:32.526553 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6f677ff9-710b-4f40-9ab3-740e74303494 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:32.533521 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f677ff9-710b-4f40-9ab3-740e74303494 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:32.534214 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f677ff9-710b-4f40-9ab3-740e74303494 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:32.534700 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f677ff9-710b-4f40-9ab3-740e74303494 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:32.535461 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f677ff9-710b-4f40-9ab3-740e74303494 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:32.535929 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f677ff9-710b-4f40-9ab3-740e74303494 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:32.536353 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f677ff9-710b-4f40-9ab3-740e74303494 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:32.552216 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=93 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:32.707309 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-6f677ff9-710b-4f40-9ab3-740e74303494 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:32.717606 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6f677ff9-710b-4f40-9ab3-740e74303494 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.195808 Oct 01 04:19:32.718321 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 91/198] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:32 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:33.740851 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e8307c15-372a-4da3-9db3-19765d6cd989 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:33.742057 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e8307c15-372a-4da3-9db3-19765d6cd989 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:33.749157 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8307c15-372a-4da3-9db3-19765d6cd989 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:33.757788 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8307c15-372a-4da3-9db3-19765d6cd989 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:33.758329 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8307c15-372a-4da3-9db3-19765d6cd989 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:33.759568 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8307c15-372a-4da3-9db3-19765d6cd989 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:33.760284 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8307c15-372a-4da3-9db3-19765d6cd989 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:33.760761 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e8307c15-372a-4da3-9db3-19765d6cd989 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:33.905881 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e8307c15-372a-4da3-9db3-19765d6cd989 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:33.916349 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e8307c15-372a-4da3-9db3-19765d6cd989 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.179360 Oct 01 04:19:33.917659 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 108/199] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:33 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:34.941811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3c2eba55-05cc-4b0e-959f-705f25dcc6ae tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:34.943003 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3c2eba55-05cc-4b0e-959f-705f25dcc6ae tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:34.949255 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c2eba55-05cc-4b0e-959f-705f25dcc6ae tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:34.950273 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c2eba55-05cc-4b0e-959f-705f25dcc6ae tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:34.951087 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c2eba55-05cc-4b0e-959f-705f25dcc6ae tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:34.952026 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c2eba55-05cc-4b0e-959f-705f25dcc6ae tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:34.952483 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c2eba55-05cc-4b0e-959f-705f25dcc6ae tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:34.952915 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3c2eba55-05cc-4b0e-959f-705f25dcc6ae tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:35.095762 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-3c2eba55-05cc-4b0e-959f-705f25dcc6ae tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:35.105016 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3c2eba55-05cc-4b0e-959f-705f25dcc6ae tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.167327 Oct 01 04:19:35.105623 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 92/200] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:34 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:19:36.127621 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a5effbbf-35b6-4655-bb3a-5f71367d4875 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:36.128771 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a5effbbf-35b6-4655-bb3a-5f71367d4875 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:36.134995 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5effbbf-35b6-4655-bb3a-5f71367d4875 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:36.135709 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5effbbf-35b6-4655-bb3a-5f71367d4875 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:36.136144 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5effbbf-35b6-4655-bb3a-5f71367d4875 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:36.137051 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5effbbf-35b6-4655-bb3a-5f71367d4875 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:36.137583 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5effbbf-35b6-4655-bb3a-5f71367d4875 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:36.138016 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a5effbbf-35b6-4655-bb3a-5f71367d4875 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:36.271774 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a5effbbf-35b6-4655-bb3a-5f71367d4875 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:36.281236 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a5effbbf-35b6-4655-bb3a-5f71367d4875 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.157429 Oct 01 04:19:36.281811 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 109/201] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:36 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:37.305707 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0ed0b02a-eb65-4892-afb2-8f48d7104909 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:37.306516 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0ed0b02a-eb65-4892-afb2-8f48d7104909 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:37.315188 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ed0b02a-eb65-4892-afb2-8f48d7104909 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:37.315978 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ed0b02a-eb65-4892-afb2-8f48d7104909 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:37.316729 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ed0b02a-eb65-4892-afb2-8f48d7104909 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:37.317471 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ed0b02a-eb65-4892-afb2-8f48d7104909 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:37.317964 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ed0b02a-eb65-4892-afb2-8f48d7104909 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:37.318448 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ed0b02a-eb65-4892-afb2-8f48d7104909 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:37.481761 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-0ed0b02a-eb65-4892-afb2-8f48d7104909 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:37.489857 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0ed0b02a-eb65-4892-afb2-8f48d7104909 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.190041 Oct 01 04:19:37.490430 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 93/202] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:37 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:38.523534 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7efd68e1-5cad-4e29-bae6-988ba5bcbbac tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:38.525197 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7efd68e1-5cad-4e29-bae6-988ba5bcbbac tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:38.539109 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7efd68e1-5cad-4e29-bae6-988ba5bcbbac tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:38.551018 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7efd68e1-5cad-4e29-bae6-988ba5bcbbac tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:38.551693 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7efd68e1-5cad-4e29-bae6-988ba5bcbbac tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:38.552442 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7efd68e1-5cad-4e29-bae6-988ba5bcbbac tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:38.552906 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7efd68e1-5cad-4e29-bae6-988ba5bcbbac tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:38.553369 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7efd68e1-5cad-4e29-bae6-988ba5bcbbac tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:38.748872 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7efd68e1-5cad-4e29-bae6-988ba5bcbbac tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:38.759443 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7efd68e1-5cad-4e29-bae6-988ba5bcbbac tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.248443 Oct 01 04:19:38.760579 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 110/203] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:38 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:39.786594 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-73205269-970e-41f4-977b-59ed3d057031 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:39.787453 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-73205269-970e-41f4-977b-59ed3d057031 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:39.797897 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73205269-970e-41f4-977b-59ed3d057031 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:39.798395 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73205269-970e-41f4-977b-59ed3d057031 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:39.798832 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73205269-970e-41f4-977b-59ed3d057031 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:39.799546 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73205269-970e-41f4-977b-59ed3d057031 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:39.800000 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73205269-970e-41f4-977b-59ed3d057031 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:39.800417 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-73205269-970e-41f4-977b-59ed3d057031 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:40.055576 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-73205269-970e-41f4-977b-59ed3d057031 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:40.066399 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-73205269-970e-41f4-977b-59ed3d057031 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1523 microversion: 2.1 time: 0.285537 Oct 01 04:19:40.067053 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 94/204] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:39 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1523 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:41.090936 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bbe200f2-aecf-49ee-bc7e-e21dddef05b1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:41.091543 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bbe200f2-aecf-49ee-bc7e-e21dddef05b1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:41.098585 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bbe200f2-aecf-49ee-bc7e-e21dddef05b1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:41.099226 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bbe200f2-aecf-49ee-bc7e-e21dddef05b1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:41.099889 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bbe200f2-aecf-49ee-bc7e-e21dddef05b1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:41.101361 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bbe200f2-aecf-49ee-bc7e-e21dddef05b1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:41.102106 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bbe200f2-aecf-49ee-bc7e-e21dddef05b1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:41.102793 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bbe200f2-aecf-49ee-bc7e-e21dddef05b1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:41.332588 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-bbe200f2-aecf-49ee-bc7e-e21dddef05b1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:41.343566 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bbe200f2-aecf-49ee-bc7e-e21dddef05b1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1503 microversion: 2.1 time: 0.256931 Oct 01 04:19:41.344239 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 111/205] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:41 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1503 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:41.367122 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1254b5e2-e2f4-468f-a1bf-e899aa38451e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:41.367750 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1254b5e2-e2f4-468f-a1bf-e899aa38451e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:41.376089 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1254b5e2-e2f4-468f-a1bf-e899aa38451e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:41.376640 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1254b5e2-e2f4-468f-a1bf-e899aa38451e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:41.377456 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1254b5e2-e2f4-468f-a1bf-e899aa38451e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:41.378175 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1254b5e2-e2f4-468f-a1bf-e899aa38451e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:41.378641 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1254b5e2-e2f4-468f-a1bf-e899aa38451e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:41.379064 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1254b5e2-e2f4-468f-a1bf-e899aa38451e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:41.562903 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-1254b5e2-e2f4-468f-a1bf-e899aa38451e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:41.572079 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1254b5e2-e2f4-468f-a1bf-e899aa38451e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a" status: 200 len: 1516 microversion: 2.1 time: 0.208805 Oct 01 04:19:41.572658 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 95/206] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:41 2022] GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a => generated 1516 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:43.065796 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-20c8bbd1-56f3-4aea-ae8b-263aba08bbda tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:19:43.069036 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-20c8bbd1-56f3-4aea-ae8b-263aba08bbda tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:43.091122 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20c8bbd1-56f3-4aea-ae8b-263aba08bbda tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:43.094594 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20c8bbd1-56f3-4aea-ae8b-263aba08bbda tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:43.095042 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20c8bbd1-56f3-4aea-ae8b-263aba08bbda tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:43.099300 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20c8bbd1-56f3-4aea-ae8b-263aba08bbda tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:43.100011 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20c8bbd1-56f3-4aea-ae8b-263aba08bbda tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:43.101929 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20c8bbd1-56f3-4aea-ae8b-263aba08bbda tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:43.143347 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-20c8bbd1-56f3-4aea-ae8b-263aba08bbda tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lazy-loading 'flavor' on Instance uuid 2906cc69-afd9-45dd-b846-38782722ed9a {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:19:43.404354 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-20c8bbd1-56f3-4aea-ae8b-263aba08bbda tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "POST /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a/action" status: 200 len: 32 microversion: 2.1 time: 0.337108 Oct 01 04:19:43.413455 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 112/207] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 1 04:19:43 2022] POST /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a/action => generated 32 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 04:19:43.419231 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4b4d1653-3036-4a3a-aa06-2c72e637afd7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:43.419979 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4b4d1653-3036-4a3a-aa06-2c72e637afd7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:43.427558 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b4d1653-3036-4a3a-aa06-2c72e637afd7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:43.434212 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b4d1653-3036-4a3a-aa06-2c72e637afd7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:43.434863 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b4d1653-3036-4a3a-aa06-2c72e637afd7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:43.435602 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b4d1653-3036-4a3a-aa06-2c72e637afd7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:43.436096 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b4d1653-3036-4a3a-aa06-2c72e637afd7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:43.437048 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4b4d1653-3036-4a3a-aa06-2c72e637afd7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:43.661402 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-4b4d1653-3036-4a3a-aa06-2c72e637afd7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:43.674516 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4b4d1653-3036-4a3a-aa06-2c72e637afd7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a" status: 200 len: 1522 microversion: 2.1 time: 0.259198 Oct 01 04:19:43.693524 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 96/208] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:43 2022] GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:44.700904 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7e7c4c7d-c6c7-47a5-b03b-b437721322ec tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:44.701715 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7e7c4c7d-c6c7-47a5-b03b-b437721322ec tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:44.711722 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e7c4c7d-c6c7-47a5-b03b-b437721322ec tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:44.712216 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e7c4c7d-c6c7-47a5-b03b-b437721322ec tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:44.712657 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e7c4c7d-c6c7-47a5-b03b-b437721322ec tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:44.713458 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e7c4c7d-c6c7-47a5-b03b-b437721322ec tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:44.713915 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e7c4c7d-c6c7-47a5-b03b-b437721322ec tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:44.714332 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7e7c4c7d-c6c7-47a5-b03b-b437721322ec tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:44.915348 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7e7c4c7d-c6c7-47a5-b03b-b437721322ec tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:44.924253 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7e7c4c7d-c6c7-47a5-b03b-b437721322ec tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a" status: 200 len: 1522 microversion: 2.1 time: 0.228163 Oct 01 04:19:44.924819 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 113/209] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:44 2022] GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:45.278885 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-36cec8cf-bc3f-41e9-97b0-2c2ade653547 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1866816119", "imageRef": "c63d52d7-4e3d-40cf-a8b5-59a2d027d793", "flavorRef": "452", "networks": [{"uuid": "53afa43e-e4f6-45fd-be82-366552325c26"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:19:45.345384 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-36cec8cf-bc3f-41e9-97b0-2c2ade653547 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] validate_networks() for [('53afa43e-e4f6-45fd-be82-366552325c26', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 04:19:45.958098 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-36cec8cf-bc3f-41e9-97b0-2c2ade653547 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 04:19:45.958528 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-36cec8cf-bc3f-41e9-97b0-2c2ade653547 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 04:19:45.958898 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4a5b823c-20a8-4742-9986-892ac1683017 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:45.959336 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-36cec8cf-bc3f-41e9-97b0-2c2ade653547 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 04:19:45.959428 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-36cec8cf-bc3f-41e9-97b0-2c2ade653547 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 04:19:45.959507 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4a5b823c-20a8-4742-9986-892ac1683017 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:45.959817 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-36cec8cf-bc3f-41e9-97b0-2c2ade653547 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 04:19:45.968654 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a5b823c-20a8-4742-9986-892ac1683017 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:45.969177 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a5b823c-20a8-4742-9986-892ac1683017 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:45.971203 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a5b823c-20a8-4742-9986-892ac1683017 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:45.971698 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36cec8cf-bc3f-41e9-97b0-2c2ade653547 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:45.972253 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36cec8cf-bc3f-41e9-97b0-2c2ade653547 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:45.972663 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36cec8cf-bc3f-41e9-97b0-2c2ade653547 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:45.973994 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a5b823c-20a8-4742-9986-892ac1683017 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:45.975087 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a5b823c-20a8-4742-9986-892ac1683017 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:45.975718 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a5b823c-20a8-4742-9986-892ac1683017 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:45.981992 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36cec8cf-bc3f-41e9-97b0-2c2ade653547 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:45.982553 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36cec8cf-bc3f-41e9-97b0-2c2ade653547 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:45.983016 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36cec8cf-bc3f-41e9-97b0-2c2ade653547 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:46.008043 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-36cec8cf-bc3f-41e9-97b0-2c2ade653547 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Getting quotas for project 6452abdab41846a5915b7ea5d81b9811. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:19:46.014008 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-36cec8cf-bc3f-41e9-97b0-2c2ade653547 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Getting quotas for user 27dc4e15e61e44c8905e713a190a45d3 and project 6452abdab41846a5915b7ea5d81b9811. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:19:46.048135 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-36cec8cf-bc3f-41e9-97b0-2c2ade653547 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 04:19:46.051527 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-36cec8cf-bc3f-41e9-97b0-2c2ade653547 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 9b645ab8-978e-40cd-b80d-6c82e666ebb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c63d52d7-4e3d-40cf-a8b5-59a2d027d793',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 04:19:46.148248 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-36cec8cf-bc3f-41e9-97b0-2c2ade653547 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.875727 Oct 01 04:19:46.158423 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 97/210] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 1 04:19:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 04:19:46.166272 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-92d0babf-8b0f-4443-aa14-4523843bb5a1 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:46.168806 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-92d0babf-8b0f-4443-aa14-4523843bb5a1 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 9b645ab8-978e-40cd-b80d-6c82e666ebb5] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:46.222949 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4a5b823c-20a8-4742-9986-892ac1683017 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:46.231944 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4a5b823c-20a8-4742-9986-892ac1683017 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a" status: 200 len: 1522 microversion: 2.1 time: 0.276736 Oct 01 04:19:46.234212 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 114/211] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:45 2022] GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:19:46.266830 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-92d0babf-8b0f-4443-aa14-4523843bb5a1 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27dc4e15e61e44c8905e713a190a45d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6452abdab41846a5915b7ea5d81b9811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:46.283038 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-92d0babf-8b0f-4443-aa14-4523843bb5a1 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5" status: 200 len: 1214 microversion: 2.1 time: 0.123280 Oct 01 04:19:46.285491 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 98/212] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:46 2022] GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5 => generated 1214 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:47.271197 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-63a40ead-3950-4b2f-87f3-34b972c572fb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:47.272639 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-63a40ead-3950-4b2f-87f3-34b972c572fb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:47.282831 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63a40ead-3950-4b2f-87f3-34b972c572fb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:47.283543 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63a40ead-3950-4b2f-87f3-34b972c572fb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:47.284193 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63a40ead-3950-4b2f-87f3-34b972c572fb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:47.285291 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63a40ead-3950-4b2f-87f3-34b972c572fb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:47.286079 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63a40ead-3950-4b2f-87f3-34b972c572fb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:47.288069 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-63a40ead-3950-4b2f-87f3-34b972c572fb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:47.318000 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a4ed1b01-f9a9-4596-b22c-98f17199fd93 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:47.318898 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a4ed1b01-f9a9-4596-b22c-98f17199fd93 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 9b645ab8-978e-40cd-b80d-6c82e666ebb5] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:47.330065 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4ed1b01-f9a9-4596-b22c-98f17199fd93 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:47.335013 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4ed1b01-f9a9-4596-b22c-98f17199fd93 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:47.336810 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4ed1b01-f9a9-4596-b22c-98f17199fd93 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:47.344610 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4ed1b01-f9a9-4596-b22c-98f17199fd93 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:47.345367 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4ed1b01-f9a9-4596-b22c-98f17199fd93 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:47.345957 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4ed1b01-f9a9-4596-b22c-98f17199fd93 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:47.509474 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-a4ed1b01-f9a9-4596-b22c-98f17199fd93 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27dc4e15e61e44c8905e713a190a45d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6452abdab41846a5915b7ea5d81b9811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:47.535319 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a4ed1b01-f9a9-4596-b22c-98f17199fd93 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5" status: 200 len: 1266 microversion: 2.1 time: 0.227584 Oct 01 04:19:47.535923 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 99/213] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:47 2022] GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5 => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:19:47.568893 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-63a40ead-3950-4b2f-87f3-34b972c572fb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:47.588811 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-63a40ead-3950-4b2f-87f3-34b972c572fb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a" status: 200 len: 1522 microversion: 2.1 time: 0.321294 Oct 01 04:19:47.590973 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 115/214] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:47 2022] GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:48.561094 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0085d9d0-0f6d-4d67-8705-a844c34a4833 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:48.561789 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0085d9d0-0f6d-4d67-8705-a844c34a4833 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 9b645ab8-978e-40cd-b80d-6c82e666ebb5] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:48.574219 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0085d9d0-0f6d-4d67-8705-a844c34a4833 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:48.575262 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0085d9d0-0f6d-4d67-8705-a844c34a4833 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:48.576165 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0085d9d0-0f6d-4d67-8705-a844c34a4833 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:48.577505 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0085d9d0-0f6d-4d67-8705-a844c34a4833 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:48.579127 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0085d9d0-0f6d-4d67-8705-a844c34a4833 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:48.581202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0085d9d0-0f6d-4d67-8705-a844c34a4833 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:48.615623 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e54f7137-ee1b-4411-a1ac-0f8f0e8cd678 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:48.618113 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e54f7137-ee1b-4411-a1ac-0f8f0e8cd678 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:48.634814 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e54f7137-ee1b-4411-a1ac-0f8f0e8cd678 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:48.637244 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e54f7137-ee1b-4411-a1ac-0f8f0e8cd678 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:48.638014 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e54f7137-ee1b-4411-a1ac-0f8f0e8cd678 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:48.639221 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e54f7137-ee1b-4411-a1ac-0f8f0e8cd678 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:48.639891 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e54f7137-ee1b-4411-a1ac-0f8f0e8cd678 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:48.641036 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e54f7137-ee1b-4411-a1ac-0f8f0e8cd678 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:48.659015 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-0085d9d0-0f6d-4d67-8705-a844c34a4833 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27dc4e15e61e44c8905e713a190a45d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6452abdab41846a5915b7ea5d81b9811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:48.668068 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0085d9d0-0f6d-4d67-8705-a844c34a4833 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5" status: 200 len: 1272 microversion: 2.1 time: 0.111512 Oct 01 04:19:48.669000 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 100/215] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:48 2022] GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5 => generated 1272 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:48.821884 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e54f7137-ee1b-4411-a1ac-0f8f0e8cd678 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:48.829833 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e54f7137-ee1b-4411-a1ac-0f8f0e8cd678 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a" status: 200 len: 1522 microversion: 2.1 time: 0.219390 Oct 01 04:19:48.830996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 116/216] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:48 2022] GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:19:49.701111 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-39258ec5-eae3-4270-81ac-df0b0efca63a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:49.701526 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-39258ec5-eae3-4270-81ac-df0b0efca63a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 9b645ab8-978e-40cd-b80d-6c82e666ebb5] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:49.718696 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39258ec5-eae3-4270-81ac-df0b0efca63a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:49.719479 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39258ec5-eae3-4270-81ac-df0b0efca63a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:49.720140 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39258ec5-eae3-4270-81ac-df0b0efca63a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:49.723457 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39258ec5-eae3-4270-81ac-df0b0efca63a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:49.724242 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39258ec5-eae3-4270-81ac-df0b0efca63a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:49.725063 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39258ec5-eae3-4270-81ac-df0b0efca63a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:49.859490 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-339b5de8-a18f-482f-8b83-f7a293d9c1f5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:49.860899 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-339b5de8-a18f-482f-8b83-f7a293d9c1f5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:49.870230 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-339b5de8-a18f-482f-8b83-f7a293d9c1f5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:49.871235 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-339b5de8-a18f-482f-8b83-f7a293d9c1f5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:49.871952 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-339b5de8-a18f-482f-8b83-f7a293d9c1f5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:49.873273 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-339b5de8-a18f-482f-8b83-f7a293d9c1f5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:49.873923 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-339b5de8-a18f-482f-8b83-f7a293d9c1f5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:49.874524 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-339b5de8-a18f-482f-8b83-f7a293d9c1f5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:50.052718 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-39258ec5-eae3-4270-81ac-df0b0efca63a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27dc4e15e61e44c8905e713a190a45d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6452abdab41846a5915b7ea5d81b9811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:50.068066 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-39258ec5-eae3-4270-81ac-df0b0efca63a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5" status: 200 len: 1314 microversion: 2.1 time: 0.377694 Oct 01 04:19:50.068660 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 101/217] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:49 2022] GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5 => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:50.280345 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-339b5de8-a18f-482f-8b83-f7a293d9c1f5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:50.294626 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-339b5de8-a18f-482f-8b83-f7a293d9c1f5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a" status: 200 len: 1522 microversion: 2.1 time: 0.441052 Oct 01 04:19:50.310635 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 117/218] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:49 2022] GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a => generated 1522 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:50.472530 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-75583c57-3728-4860-a977-bd4b73eea627 req-15107f02-27b9-4fd8-895b-c8438baee3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b645ab8-978e-40cd-b80d-6c82e666ebb5", "tag": "ebe95b99-24a6-44fb-8c24-2e123866c304"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:19:50.489485 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-75583c57-3728-4860-a977-bd4b73eea627 req-15107f02-27b9-4fd8-895b-c8438baee3c2 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:50.492393 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-75583c57-3728-4860-a977-bd4b73eea627 req-15107f02-27b9-4fd8-895b-c8438baee3c2 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:50.495134 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-75583c57-3728-4860-a977-bd4b73eea627 req-15107f02-27b9-4fd8-895b-c8438baee3c2 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:50.523981 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-75583c57-3728-4860-a977-bd4b73eea627 req-15107f02-27b9-4fd8-895b-c8438baee3c2 service nova] Creating event network-changed:ebe95b99-24a6-44fb-8c24-2e123866c304 for instance 9b645ab8-978e-40cd-b80d-6c82e666ebb5 on hv-cinder-86004 Oct 01 04:19:50.535941 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-75583c57-3728-4860-a977-bd4b73eea627 req-15107f02-27b9-4fd8-895b-c8438baee3c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067301 Oct 01 04:19:50.538398 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 102/219] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:19:51.094040 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1cb9859b-8bba-4797-bfdc-e2bf7057d60a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:51.096120 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1cb9859b-8bba-4797-bfdc-e2bf7057d60a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 9b645ab8-978e-40cd-b80d-6c82e666ebb5] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:51.104692 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cb9859b-8bba-4797-bfdc-e2bf7057d60a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:51.105790 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cb9859b-8bba-4797-bfdc-e2bf7057d60a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:51.106499 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cb9859b-8bba-4797-bfdc-e2bf7057d60a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:51.107807 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cb9859b-8bba-4797-bfdc-e2bf7057d60a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:51.109025 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cb9859b-8bba-4797-bfdc-e2bf7057d60a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:51.109681 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cb9859b-8bba-4797-bfdc-e2bf7057d60a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:51.325843 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-338d7b62-5544-4a59-9d2e-b38e2ff8a19f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:51.326553 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-338d7b62-5544-4a59-9d2e-b38e2ff8a19f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:51.344325 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-338d7b62-5544-4a59-9d2e-b38e2ff8a19f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:51.344987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-338d7b62-5544-4a59-9d2e-b38e2ff8a19f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:51.345648 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-338d7b62-5544-4a59-9d2e-b38e2ff8a19f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:51.347058 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-338d7b62-5544-4a59-9d2e-b38e2ff8a19f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:51.347677 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-338d7b62-5544-4a59-9d2e-b38e2ff8a19f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:51.348257 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-338d7b62-5544-4a59-9d2e-b38e2ff8a19f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:51.482868 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1cb9859b-8bba-4797-bfdc-e2bf7057d60a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27dc4e15e61e44c8905e713a190a45d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6452abdab41846a5915b7ea5d81b9811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:51.493498 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1cb9859b-8bba-4797-bfdc-e2bf7057d60a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5" status: 200 len: 1314 microversion: 2.1 time: 0.404454 Oct 01 04:19:51.494557 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 118/220] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:51 2022] GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:19:51.671053 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-338d7b62-5544-4a59-9d2e-b38e2ff8a19f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:51.683102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-338d7b62-5544-4a59-9d2e-b38e2ff8a19f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a" status: 200 len: 1522 microversion: 2.1 time: 0.366912 Oct 01 04:19:51.692553 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 103/221] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:51 2022] GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a => generated 1522 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:52.531334 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b8e1b989-8846-4164-8394-883078bbef09 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:52.531966 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b8e1b989-8846-4164-8394-883078bbef09 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 9b645ab8-978e-40cd-b80d-6c82e666ebb5] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:52.551016 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8e1b989-8846-4164-8394-883078bbef09 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:52.551677 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8e1b989-8846-4164-8394-883078bbef09 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:52.552016 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8e1b989-8846-4164-8394-883078bbef09 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:52.552784 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8e1b989-8846-4164-8394-883078bbef09 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:52.556493 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8e1b989-8846-4164-8394-883078bbef09 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:52.557236 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b8e1b989-8846-4164-8394-883078bbef09 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:52.695608 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d75297a3-01d4-4040-9463-33bf1eef6cde tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:52.696279 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d75297a3-01d4-4040-9463-33bf1eef6cde tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:52.706251 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d75297a3-01d4-4040-9463-33bf1eef6cde tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:52.706859 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d75297a3-01d4-4040-9463-33bf1eef6cde tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:52.707218 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d75297a3-01d4-4040-9463-33bf1eef6cde tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:52.707930 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d75297a3-01d4-4040-9463-33bf1eef6cde tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:52.708388 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d75297a3-01d4-4040-9463-33bf1eef6cde tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:52.708812 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d75297a3-01d4-4040-9463-33bf1eef6cde tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:52.791795 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d75297a3-01d4-4040-9463-33bf1eef6cde tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2/ips" status: 200 len: 151 microversion: 2.20 time: 0.102656 Oct 01 04:19:52.798289 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 104/222] 10.222.0.26 () {60 vars in 1289 bytes} [Sat Oct 1 04:19:52 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2/ips => generated 151 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 04:19:52.822766 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-74041455-6680-4ce6-9188-69b439d3223f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:52.823402 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-74041455-6680-4ce6-9188-69b439d3223f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:52.853348 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74041455-6680-4ce6-9188-69b439d3223f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:52.853728 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74041455-6680-4ce6-9188-69b439d3223f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:52.854171 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74041455-6680-4ce6-9188-69b439d3223f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:52.854930 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74041455-6680-4ce6-9188-69b439d3223f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:52.855398 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74041455-6680-4ce6-9188-69b439d3223f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:52.855831 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-74041455-6680-4ce6-9188-69b439d3223f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:52.877569 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b8e1b989-8846-4164-8394-883078bbef09 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27dc4e15e61e44c8905e713a190a45d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6452abdab41846a5915b7ea5d81b9811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:52.889316 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b8e1b989-8846-4164-8394-883078bbef09 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5" status: 200 len: 1314 microversion: 2.1 time: 0.371994 Oct 01 04:19:52.896338 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 119/223] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:52 2022] GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:53.043549 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-74041455-6680-4ce6-9188-69b439d3223f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:53.052913 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-74041455-6680-4ce6-9188-69b439d3223f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a" status: 200 len: 1522 microversion: 2.1 time: 0.252538 Oct 01 04:19:53.053959 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 105/224] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:52 2022] GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:53.918846 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-092f2333-590f-4d94-afe2-442617e663ed tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:53.920125 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-092f2333-590f-4d94-afe2-442617e663ed tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 9b645ab8-978e-40cd-b80d-6c82e666ebb5] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:53.958424 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-092f2333-590f-4d94-afe2-442617e663ed tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:53.960327 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-092f2333-590f-4d94-afe2-442617e663ed tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:53.961125 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-092f2333-590f-4d94-afe2-442617e663ed tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:53.962383 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-092f2333-590f-4d94-afe2-442617e663ed tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:53.968140 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-092f2333-590f-4d94-afe2-442617e663ed tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:53.968589 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-092f2333-590f-4d94-afe2-442617e663ed tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:54.082181 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-08b5d95b-ca9d-4f56-af6f-cfc9a96a8cad tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:54.083215 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-08b5d95b-ca9d-4f56-af6f-cfc9a96a8cad tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:54.100071 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08b5d95b-ca9d-4f56-af6f-cfc9a96a8cad tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:54.100611 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08b5d95b-ca9d-4f56-af6f-cfc9a96a8cad tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:54.102360 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08b5d95b-ca9d-4f56-af6f-cfc9a96a8cad tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:54.103465 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08b5d95b-ca9d-4f56-af6f-cfc9a96a8cad tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:54.103951 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08b5d95b-ca9d-4f56-af6f-cfc9a96a8cad tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:54.104386 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-08b5d95b-ca9d-4f56-af6f-cfc9a96a8cad tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:54.481574 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-092f2333-590f-4d94-afe2-442617e663ed tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27dc4e15e61e44c8905e713a190a45d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6452abdab41846a5915b7ea5d81b9811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:54.487871 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:54.494852 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-092f2333-590f-4d94-afe2-442617e663ed tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5" status: 200 len: 1314 microversion: 2.1 time: 0.582721 Oct 01 04:19:54.497137 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 120/225] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:53 2022] GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5 => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:54.609760 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-08b5d95b-ca9d-4f56-af6f-cfc9a96a8cad tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:54.623681 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-08b5d95b-ca9d-4f56-af6f-cfc9a96a8cad tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a" status: 200 len: 1522 microversion: 2.1 time: 0.548027 Oct 01 04:19:54.626975 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 106/226] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:54 2022] GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a => generated 1522 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:55.523627 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-18a5533d-e238-4ee4-821b-eee70bd1321b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:55.524281 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-18a5533d-e238-4ee4-821b-eee70bd1321b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 9b645ab8-978e-40cd-b80d-6c82e666ebb5] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:55.532886 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=34 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:55.534795 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18a5533d-e238-4ee4-821b-eee70bd1321b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:55.535506 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18a5533d-e238-4ee4-821b-eee70bd1321b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:55.536199 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18a5533d-e238-4ee4-821b-eee70bd1321b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:55.537161 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18a5533d-e238-4ee4-821b-eee70bd1321b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:55.537773 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18a5533d-e238-4ee4-821b-eee70bd1321b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:55.538388 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18a5533d-e238-4ee4-821b-eee70bd1321b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:55.649298 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b292dba3-b1fe-4ccc-aec2-786bada6764a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:55.651173 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b292dba3-b1fe-4ccc-aec2-786bada6764a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:55.665695 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b292dba3-b1fe-4ccc-aec2-786bada6764a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:55.667684 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b292dba3-b1fe-4ccc-aec2-786bada6764a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:55.668582 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b292dba3-b1fe-4ccc-aec2-786bada6764a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:55.670706 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b292dba3-b1fe-4ccc-aec2-786bada6764a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:55.672875 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b292dba3-b1fe-4ccc-aec2-786bada6764a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:55.675206 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b292dba3-b1fe-4ccc-aec2-786bada6764a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:55.889436 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-18a5533d-e238-4ee4-821b-eee70bd1321b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27dc4e15e61e44c8905e713a190a45d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6452abdab41846a5915b7ea5d81b9811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:55.902851 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-18a5533d-e238-4ee4-821b-eee70bd1321b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5" status: 200 len: 1314 microversion: 2.1 time: 0.383502 Oct 01 04:19:55.906202 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 121/227] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:55 2022] GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:55.922209 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8719c3fd-43cb-4fe0-881a-65aabbcd76e7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:55.922983 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8719c3fd-43cb-4fe0-881a-65aabbcd76e7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:55.937031 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8719c3fd-43cb-4fe0-881a-65aabbcd76e7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:55.940243 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8719c3fd-43cb-4fe0-881a-65aabbcd76e7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:55.940889 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8719c3fd-43cb-4fe0-881a-65aabbcd76e7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:55.942419 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8719c3fd-43cb-4fe0-881a-65aabbcd76e7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:55.943648 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8719c3fd-43cb-4fe0-881a-65aabbcd76e7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:55.946553 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8719c3fd-43cb-4fe0-881a-65aabbcd76e7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:55.991103 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-b292dba3-b1fe-4ccc-aec2-786bada6764a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:55.994274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:56.004790 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b292dba3-b1fe-4ccc-aec2-786bada6764a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a" status: 200 len: 1522 microversion: 2.1 time: 0.359919 Oct 01 04:19:56.006039 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 107/228] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:55 2022] GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:56.012463 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8719c3fd-43cb-4fe0-881a-65aabbcd76e7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69/ips" status: 200 len: 145 microversion: 2.1 time: 0.104884 Oct 01 04:19:56.013123 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 122/229] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 1 04:19:55 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69/ips => generated 145 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:19:56.042836 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-4fbba4e0-dc0d-4987-a906-bc1ef636b6bd req-773d75b6-2e0e-4ec2-8bbe-f47cac3bc9a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b645ab8-978e-40cd-b80d-6c82e666ebb5", "name": "network-vif-plugged", "status": "completed", "tag": "ebe95b99-24a6-44fb-8c24-2e123866c304"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:19:56.065073 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4fbba4e0-dc0d-4987-a906-bc1ef636b6bd req-773d75b6-2e0e-4ec2-8bbe-f47cac3bc9a1 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:56.066137 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4fbba4e0-dc0d-4987-a906-bc1ef636b6bd req-773d75b6-2e0e-4ec2-8bbe-f47cac3bc9a1 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:56.066750 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4fbba4e0-dc0d-4987-a906-bc1ef636b6bd req-773d75b6-2e0e-4ec2-8bbe-f47cac3bc9a1 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:56.289032 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=8 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:56.291335 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-4fbba4e0-dc0d-4987-a906-bc1ef636b6bd req-773d75b6-2e0e-4ec2-8bbe-f47cac3bc9a1 service nova] Creating event network-vif-plugged:ebe95b99-24a6-44fb-8c24-2e123866c304 for instance 9b645ab8-978e-40cd-b80d-6c82e666ebb5 on hv-cinder-86004 Oct 01 04:19:56.297534 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-4fbba4e0-dc0d-4987-a906-bc1ef636b6bd req-773d75b6-2e0e-4ec2-8bbe-f47cac3bc9a1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.262316 Oct 01 04:19:56.298691 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 108/230] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:19:56.533328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-948d0c25-9d8e-45c0-b8e2-80eca5ca4369 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:19:56.534617 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-948d0c25-9d8e-45c0-b8e2-80eca5ca4369 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:56.550364 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-948d0c25-9d8e-45c0-b8e2-80eca5ca4369 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:56.550867 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-948d0c25-9d8e-45c0-b8e2-80eca5ca4369 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:56.551374 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-948d0c25-9d8e-45c0-b8e2-80eca5ca4369 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:56.552032 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-948d0c25-9d8e-45c0-b8e2-80eca5ca4369 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:56.552494 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-948d0c25-9d8e-45c0-b8e2-80eca5ca4369 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:56.552956 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-948d0c25-9d8e-45c0-b8e2-80eca5ca4369 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:56.658222 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-948d0c25-9d8e-45c0-b8e2-80eca5ca4369 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lazy-loading 'flavor' on Instance uuid e14e3570-67e7-43d6-bcaf-6688168956b2 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:19:56.933956 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e53f385c-36c4-40c3-8f03-492980eace67 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:56.935270 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e53f385c-36c4-40c3-8f03-492980eace67 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 9b645ab8-978e-40cd-b80d-6c82e666ebb5] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:56.945419 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e53f385c-36c4-40c3-8f03-492980eace67 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:56.946240 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e53f385c-36c4-40c3-8f03-492980eace67 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:56.947409 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e53f385c-36c4-40c3-8f03-492980eace67 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:56.949274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e53f385c-36c4-40c3-8f03-492980eace67 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:56.950537 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e53f385c-36c4-40c3-8f03-492980eace67 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:56.951499 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e53f385c-36c4-40c3-8f03-492980eace67 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:57.127359 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-948d0c25-9d8e-45c0-b8e2-80eca5ca4369 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "POST /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2/action" status: 202 len: 0 microversion: 2.20 time: 0.604649 Oct 01 04:19:57.129812 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 123/231] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 1 04:19:56 2022] POST /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2/action => generated 0 bytes in 609 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 01 04:19:57.160102 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-da3a547e-7dc3-4b77-bf4b-cdfdaa541328 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:57.161287 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-da3a547e-7dc3-4b77-bf4b-cdfdaa541328 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:57.192300 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da3a547e-7dc3-4b77-bf4b-cdfdaa541328 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:57.193510 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da3a547e-7dc3-4b77-bf4b-cdfdaa541328 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:57.194532 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da3a547e-7dc3-4b77-bf4b-cdfdaa541328 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:57.195579 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da3a547e-7dc3-4b77-bf4b-cdfdaa541328 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:57.196302 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da3a547e-7dc3-4b77-bf4b-cdfdaa541328 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:57.196962 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-da3a547e-7dc3-4b77-bf4b-cdfdaa541328 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:57.285076 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-e53f385c-36c4-40c3-8f03-492980eace67 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27dc4e15e61e44c8905e713a190a45d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6452abdab41846a5915b7ea5d81b9811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:57.296306 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e53f385c-36c4-40c3-8f03-492980eace67 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5" status: 200 len: 1314 microversion: 2.1 time: 0.368663 Oct 01 04:19:57.317359 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 109/232] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:56 2022] GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:57.328675 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fdbcf5ad-3bb4-4dc9-a215-8933d80a2ec0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:57.336496 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fdbcf5ad-3bb4-4dc9-a215-8933d80a2ec0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:57.353860 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fdbcf5ad-3bb4-4dc9-a215-8933d80a2ec0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:57.354463 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fdbcf5ad-3bb4-4dc9-a215-8933d80a2ec0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:57.355350 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fdbcf5ad-3bb4-4dc9-a215-8933d80a2ec0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:57.356103 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fdbcf5ad-3bb4-4dc9-a215-8933d80a2ec0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:57.356555 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fdbcf5ad-3bb4-4dc9-a215-8933d80a2ec0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:57.356997 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fdbcf5ad-3bb4-4dc9-a215-8933d80a2ec0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:57.622000 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-da3a547e-7dc3-4b77-bf4b-cdfdaa541328 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:57.638575 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-da3a547e-7dc3-4b77-bf4b-cdfdaa541328 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a" status: 200 len: 1522 microversion: 2.1 time: 0.505975 Oct 01 04:19:57.641059 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 124/233] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:57 2022] GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a => generated 1522 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:57.732294 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-fdbcf5ad-3bb4-4dc9-a215-8933d80a2ec0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:57.750548 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-fdbcf5ad-3bb4-4dc9-a215-8933d80a2ec0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:57.756859 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-fdbcf5ad-3bb4-4dc9-a215-8933d80a2ec0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:57.767973 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fdbcf5ad-3bb4-4dc9-a215-8933d80a2ec0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1724 microversion: 2.20 time: 0.443709 Oct 01 04:19:57.770137 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 110/234] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:19:57 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1724 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:19:58.322065 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b1e9289a-10bb-4633-8283-4dc3c22a68bf tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:58.322679 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b1e9289a-10bb-4633-8283-4dc3c22a68bf tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 9b645ab8-978e-40cd-b80d-6c82e666ebb5] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:58.334075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1e9289a-10bb-4633-8283-4dc3c22a68bf tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:58.336973 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1e9289a-10bb-4633-8283-4dc3c22a68bf tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:58.338925 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1e9289a-10bb-4633-8283-4dc3c22a68bf tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:58.341780 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1e9289a-10bb-4633-8283-4dc3c22a68bf tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:58.342414 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1e9289a-10bb-4633-8283-4dc3c22a68bf tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:58.343845 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1e9289a-10bb-4633-8283-4dc3c22a68bf tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:58.666508 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b1e9289a-10bb-4633-8283-4dc3c22a68bf tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27dc4e15e61e44c8905e713a190a45d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6452abdab41846a5915b7ea5d81b9811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:58.670192 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-89396739-6bbc-47c2-9866-e25beb6f88b5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:58.672337 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-89396739-6bbc-47c2-9866-e25beb6f88b5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:58.676529 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b1e9289a-10bb-4633-8283-4dc3c22a68bf tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5" status: 200 len: 1314 microversion: 2.1 time: 0.358134 Oct 01 04:19:58.684857 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 125/235] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:58 2022] GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:19:58.685432 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:58.688264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89396739-6bbc-47c2-9866-e25beb6f88b5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:58.689911 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89396739-6bbc-47c2-9866-e25beb6f88b5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:58.694078 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89396739-6bbc-47c2-9866-e25beb6f88b5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:58.694890 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89396739-6bbc-47c2-9866-e25beb6f88b5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:58.696621 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89396739-6bbc-47c2-9866-e25beb6f88b5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:58.697111 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-89396739-6bbc-47c2-9866-e25beb6f88b5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:58.703601 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:19:58.802334 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-864a7560-c356-4eeb-a3ab-56597c61055c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:58.803120 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-864a7560-c356-4eeb-a3ab-56597c61055c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:58.819103 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-864a7560-c356-4eeb-a3ab-56597c61055c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:58.820339 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-864a7560-c356-4eeb-a3ab-56597c61055c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:58.827164 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-864a7560-c356-4eeb-a3ab-56597c61055c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:58.828231 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-864a7560-c356-4eeb-a3ab-56597c61055c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:58.830483 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-864a7560-c356-4eeb-a3ab-56597c61055c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:58.831653 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-864a7560-c356-4eeb-a3ab-56597c61055c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:58.989799 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-89396739-6bbc-47c2-9866-e25beb6f88b5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:59.000881 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-89396739-6bbc-47c2-9866-e25beb6f88b5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a" status: 200 len: 1522 microversion: 2.1 time: 0.335688 Oct 01 04:19:59.002317 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 111/236] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:58 2022] GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:19:59.112219 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4f3a257f-205d-47f2-9822-c59dfc661de1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac1f5ede-cb5c-4137-80b9-52416c28cbf0"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:19:59.115516 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4f3a257f-205d-47f2-9822-c59dfc661de1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:59.125306 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f3a257f-205d-47f2-9822-c59dfc661de1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:59.126150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f3a257f-205d-47f2-9822-c59dfc661de1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:59.127080 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f3a257f-205d-47f2-9822-c59dfc661de1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:59.127997 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f3a257f-205d-47f2-9822-c59dfc661de1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:59.128628 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f3a257f-205d-47f2-9822-c59dfc661de1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:59.129261 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4f3a257f-205d-47f2-9822-c59dfc661de1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:59.171439 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-864a7560-c356-4eeb-a3ab-56597c61055c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:59.182293 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-864a7560-c356-4eeb-a3ab-56597c61055c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:59.187294 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-864a7560-c356-4eeb-a3ab-56597c61055c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:19:59.192516 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-864a7560-c356-4eeb-a3ab-56597c61055c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1724 microversion: 2.20 time: 0.394334 Oct 01 04:19:59.205940 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 126/237] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:19:58 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1724 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:19:59.711354 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9df6d39a-e4d8-414b-9a70-692a4122252b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:19:59.712070 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9df6d39a-e4d8-414b-9a70-692a4122252b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 9b645ab8-978e-40cd-b80d-6c82e666ebb5] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:19:59.723269 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9df6d39a-e4d8-414b-9a70-692a4122252b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:59.726471 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9df6d39a-e4d8-414b-9a70-692a4122252b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:59.730607 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9df6d39a-e4d8-414b-9a70-692a4122252b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:19:59.731555 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9df6d39a-e4d8-414b-9a70-692a4122252b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:19:59.732128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9df6d39a-e4d8-414b-9a70-692a4122252b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:19:59.732680 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9df6d39a-e4d8-414b-9a70-692a4122252b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:00.270070 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4f3a257f-205d-47f2-9822-c59dfc661de1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "POST /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.164206 Oct 01 04:20:00.271518 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 112/238] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 1 04:19:59 2022] POST /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69/os-volume_attachments => generated 194 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:20:00.289102 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-9df6d39a-e4d8-414b-9a70-692a4122252b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27dc4e15e61e44c8905e713a190a45d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6452abdab41846a5915b7ea5d81b9811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:00.322410 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9df6d39a-e4d8-414b-9a70-692a4122252b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5" status: 200 len: 1314 microversion: 2.1 time: 0.615877 Oct 01 04:20:00.325956 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 127/239] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:19:59 2022] GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5 => generated 1314 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:20:00.331804 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-deaccecd-750f-4095-804a-5b10df267e33 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:00.333463 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-deaccecd-750f-4095-804a-5b10df267e33 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:00.337404 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4ca02460-ce04-459e-a256-66d1853aceae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:00.339126 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4ca02460-ce04-459e-a256-66d1853aceae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:00.360422 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ca02460-ce04-459e-a256-66d1853aceae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:00.363625 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ca02460-ce04-459e-a256-66d1853aceae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:00.365555 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ca02460-ce04-459e-a256-66d1853aceae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:00.366500 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ca02460-ce04-459e-a256-66d1853aceae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:00.367789 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-deaccecd-750f-4095-804a-5b10df267e33 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:00.369098 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ca02460-ce04-459e-a256-66d1853aceae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:00.372534 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-deaccecd-750f-4095-804a-5b10df267e33 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:00.373312 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4ca02460-ce04-459e-a256-66d1853aceae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:00.374014 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-deaccecd-750f-4095-804a-5b10df267e33 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:00.374934 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-deaccecd-750f-4095-804a-5b10df267e33 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:00.378933 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-deaccecd-750f-4095-804a-5b10df267e33 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:00.379194 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-deaccecd-750f-4095-804a-5b10df267e33 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:01.072688 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4ca02460-ce04-459e-a256-66d1853aceae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:01.099282 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4ca02460-ce04-459e-a256-66d1853aceae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:01.105803 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4ca02460-ce04-459e-a256-66d1853aceae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:01.107445 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4ca02460-ce04-459e-a256-66d1853aceae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1724 microversion: 2.20 time: 0.778907 Oct 01 04:20:01.132024 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-deaccecd-750f-4095-804a-5b10df267e33 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:01.151542 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 128/240] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:00 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1724 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:20:01.157135 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-deaccecd-750f-4095-804a-5b10df267e33 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a" status: 200 len: 1522 microversion: 2.1 time: 0.884089 Oct 01 04:20:01.157838 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 113/241] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:00 2022] GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a => generated 1522 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:01.352662 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2f95ccde-6bcf-4b66-ba88-4e6b3358544d tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:01.353390 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2f95ccde-6bcf-4b66-ba88-4e6b3358544d tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 9b645ab8-978e-40cd-b80d-6c82e666ebb5] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:01.367008 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f95ccde-6bcf-4b66-ba88-4e6b3358544d tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:01.372347 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f95ccde-6bcf-4b66-ba88-4e6b3358544d tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:01.373329 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f95ccde-6bcf-4b66-ba88-4e6b3358544d tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:01.374430 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f95ccde-6bcf-4b66-ba88-4e6b3358544d tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:01.375222 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f95ccde-6bcf-4b66-ba88-4e6b3358544d tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:01.375726 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f95ccde-6bcf-4b66-ba88-4e6b3358544d tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:01.819814 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2f95ccde-6bcf-4b66-ba88-4e6b3358544d tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27dc4e15e61e44c8905e713a190a45d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6452abdab41846a5915b7ea5d81b9811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:01.833310 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2f95ccde-6bcf-4b66-ba88-4e6b3358544d tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5" status: 200 len: 1499 microversion: 2.1 time: 0.485112 Oct 01 04:20:01.834818 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 129/242] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:01 2022] GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5 => generated 1499 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:02.149201 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-61d15017-8308-451d-b3bc-74f7e5d5aa92 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:02.149649 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-61d15017-8308-451d-b3bc-74f7e5d5aa92 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:02.169580 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61d15017-8308-451d-b3bc-74f7e5d5aa92 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:02.171468 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61d15017-8308-451d-b3bc-74f7e5d5aa92 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:02.173363 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61d15017-8308-451d-b3bc-74f7e5d5aa92 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:02.175538 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61d15017-8308-451d-b3bc-74f7e5d5aa92 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:02.177732 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61d15017-8308-451d-b3bc-74f7e5d5aa92 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:02.178567 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61d15017-8308-451d-b3bc-74f7e5d5aa92 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:02.189044 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3a7c08da-9fbc-48dc-a98d-31b8273bdfb0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:02.190770 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3a7c08da-9fbc-48dc-a98d-31b8273bdfb0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:02.205051 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a7c08da-9fbc-48dc-a98d-31b8273bdfb0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:02.205584 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a7c08da-9fbc-48dc-a98d-31b8273bdfb0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:02.206210 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a7c08da-9fbc-48dc-a98d-31b8273bdfb0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:02.215726 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a7c08da-9fbc-48dc-a98d-31b8273bdfb0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:02.216290 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a7c08da-9fbc-48dc-a98d-31b8273bdfb0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:02.216984 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3a7c08da-9fbc-48dc-a98d-31b8273bdfb0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:02.684551 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-61d15017-8308-451d-b3bc-74f7e5d5aa92 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:02.691573 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-3a7c08da-9fbc-48dc-a98d-31b8273bdfb0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:02.719844 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3a7c08da-9fbc-48dc-a98d-31b8273bdfb0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a" status: 200 len: 1522 microversion: 2.1 time: 0.535620 Oct 01 04:20:02.725455 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 130/243] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:02 2022] GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a => generated 1522 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:02.726375 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-61d15017-8308-451d-b3bc-74f7e5d5aa92 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:02.736355 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-61d15017-8308-451d-b3bc-74f7e5d5aa92 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:02.737720 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-61d15017-8308-451d-b3bc-74f7e5d5aa92 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1724 microversion: 2.20 time: 0.594969 Oct 01 04:20:02.749174 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 114/244] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:02 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1724 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:20:02.756866 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-be628440-42e0-416f-9750-f94fb3b94a5a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:02.758438 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-be628440-42e0-416f-9750-f94fb3b94a5a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 9b645ab8-978e-40cd-b80d-6c82e666ebb5] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:02.773898 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be628440-42e0-416f-9750-f94fb3b94a5a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:02.775373 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be628440-42e0-416f-9750-f94fb3b94a5a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:02.775373 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be628440-42e0-416f-9750-f94fb3b94a5a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:02.776056 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be628440-42e0-416f-9750-f94fb3b94a5a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:02.776792 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be628440-42e0-416f-9750-f94fb3b94a5a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:02.777286 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be628440-42e0-416f-9750-f94fb3b94a5a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:02.812487 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-be628440-42e0-416f-9750-f94fb3b94a5a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 9b645ab8-978e-40cd-b80d-6c82e666ebb5] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 04:20:02.975484 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-be628440-42e0-416f-9750-f94fb3b94a5a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5" status: 204 len: 0 microversion: 2.1 time: 0.247439 Oct 01 04:20:02.977194 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 131/245] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 1 04:20:02 2022] DELETE /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 04:20:02.986397 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f37bc457-2b9c-4ac4-8029-c50051742543 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:02.987751 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f37bc457-2b9c-4ac4-8029-c50051742543 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 9b645ab8-978e-40cd-b80d-6c82e666ebb5] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:02.998139 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f37bc457-2b9c-4ac4-8029-c50051742543 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:02.998905 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f37bc457-2b9c-4ac4-8029-c50051742543 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:02.999580 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f37bc457-2b9c-4ac4-8029-c50051742543 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:03.000582 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f37bc457-2b9c-4ac4-8029-c50051742543 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:03.001316 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f37bc457-2b9c-4ac4-8029-c50051742543 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:03.001962 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f37bc457-2b9c-4ac4-8029-c50051742543 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:03.482329 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-f37bc457-2b9c-4ac4-8029-c50051742543 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27dc4e15e61e44c8905e713a190a45d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6452abdab41846a5915b7ea5d81b9811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:03.493718 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f37bc457-2b9c-4ac4-8029-c50051742543 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5" status: 200 len: 1505 microversion: 2.1 time: 0.511504 Oct 01 04:20:03.502042 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 115/246] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:02 2022] GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5 => generated 1505 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:20:03.782802 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-341ebf46-ec51-4190-9b1d-62b8998cbc94 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:03.783681 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-341ebf46-ec51-4190-9b1d-62b8998cbc94 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:03.788056 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-65c57d7f-8531-42f5-8599-a81595a378c2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:03.790883 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-65c57d7f-8531-42f5-8599-a81595a378c2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:03.812916 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-341ebf46-ec51-4190-9b1d-62b8998cbc94 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:03.813464 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-341ebf46-ec51-4190-9b1d-62b8998cbc94 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:03.813909 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-341ebf46-ec51-4190-9b1d-62b8998cbc94 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:03.814657 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-341ebf46-ec51-4190-9b1d-62b8998cbc94 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:03.815119 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-341ebf46-ec51-4190-9b1d-62b8998cbc94 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:03.815541 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-341ebf46-ec51-4190-9b1d-62b8998cbc94 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:03.869772 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65c57d7f-8531-42f5-8599-a81595a378c2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:03.871216 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65c57d7f-8531-42f5-8599-a81595a378c2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:03.871830 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65c57d7f-8531-42f5-8599-a81595a378c2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:03.872730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65c57d7f-8531-42f5-8599-a81595a378c2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:03.877543 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65c57d7f-8531-42f5-8599-a81595a378c2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:03.878559 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-65c57d7f-8531-42f5-8599-a81595a378c2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:04.931567 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-341ebf46-ec51-4190-9b1d-62b8998cbc94 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:04.962324 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-341ebf46-ec51-4190-9b1d-62b8998cbc94 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:04.976897 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-341ebf46-ec51-4190-9b1d-62b8998cbc94 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:04.986062 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-341ebf46-ec51-4190-9b1d-62b8998cbc94 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1724 microversion: 2.20 time: 1.208170 Oct 01 04:20:04.987006 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 116/247] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:03 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1724 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:20:05.008164 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-59e1324a-6a1f-4747-9dc3-ab57c4618598 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:05.008735 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-59e1324a-6a1f-4747-9dc3-ab57c4618598 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 9b645ab8-978e-40cd-b80d-6c82e666ebb5] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:05.024161 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-65c57d7f-8531-42f5-8599-a81595a378c2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:05.048491 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-65c57d7f-8531-42f5-8599-a81595a378c2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a" status: 200 len: 1522 microversion: 2.1 time: 1.283587 Oct 01 04:20:05.049215 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 132/248] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:03 2022] GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a => generated 1522 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:05.049576 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59e1324a-6a1f-4747-9dc3-ab57c4618598 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:05.050089 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59e1324a-6a1f-4747-9dc3-ab57c4618598 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:05.050575 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59e1324a-6a1f-4747-9dc3-ab57c4618598 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:05.051341 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59e1324a-6a1f-4747-9dc3-ab57c4618598 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:05.051843 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59e1324a-6a1f-4747-9dc3-ab57c4618598 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:05.052318 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59e1324a-6a1f-4747-9dc3-ab57c4618598 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:05.378831 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-59e1324a-6a1f-4747-9dc3-ab57c4618598 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27dc4e15e61e44c8905e713a190a45d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6452abdab41846a5915b7ea5d81b9811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:05.394696 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-59e1324a-6a1f-4747-9dc3-ab57c4618598 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5" status: 200 len: 1505 microversion: 2.1 time: 0.406654 Oct 01 04:20:05.404966 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 117/249] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:04 2022] GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5 => generated 1505 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:05.590233 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-c726a681-19e2-4451-9c7c-ff7d932f2e7c req-f39b48e4-adc9-4a51-abca-378c97a122be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b645ab8-978e-40cd-b80d-6c82e666ebb5", "name": "network-vif-deleted", "tag": "ebe95b99-24a6-44fb-8c24-2e123866c304"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:20:05.612424 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c726a681-19e2-4451-9c7c-ff7d932f2e7c req-f39b48e4-adc9-4a51-abca-378c97a122be service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:05.618359 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c726a681-19e2-4451-9c7c-ff7d932f2e7c req-f39b48e4-adc9-4a51-abca-378c97a122be service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:05.619819 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c726a681-19e2-4451-9c7c-ff7d932f2e7c req-f39b48e4-adc9-4a51-abca-378c97a122be service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:05.664640 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-c726a681-19e2-4451-9c7c-ff7d932f2e7c req-f39b48e4-adc9-4a51-abca-378c97a122be service nova] Creating event network-vif-deleted:ebe95b99-24a6-44fb-8c24-2e123866c304 for instance 9b645ab8-978e-40cd-b80d-6c82e666ebb5 on hv-cinder-86004 Oct 01 04:20:05.678117 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-c726a681-19e2-4451-9c7c-ff7d932f2e7c req-f39b48e4-adc9-4a51-abca-378c97a122be service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093738 Oct 01 04:20:05.679943 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 133/250] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:20:06.014901 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-36c9290a-4b13-44df-b0d6-cbd2e471f013 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:06.015526 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-36c9290a-4b13-44df-b0d6-cbd2e471f013 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:06.028686 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36c9290a-4b13-44df-b0d6-cbd2e471f013 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:06.045395 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36c9290a-4b13-44df-b0d6-cbd2e471f013 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:06.046026 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36c9290a-4b13-44df-b0d6-cbd2e471f013 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:06.046810 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36c9290a-4b13-44df-b0d6-cbd2e471f013 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:06.052649 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36c9290a-4b13-44df-b0d6-cbd2e471f013 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:06.065216 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-36c9290a-4b13-44df-b0d6-cbd2e471f013 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:06.072426 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b3b0c785-d8f4-48da-91ff-77f16df16053 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:06.075774 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b3b0c785-d8f4-48da-91ff-77f16df16053 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:06.092514 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3b0c785-d8f4-48da-91ff-77f16df16053 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:06.093598 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3b0c785-d8f4-48da-91ff-77f16df16053 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:06.094078 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3b0c785-d8f4-48da-91ff-77f16df16053 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:06.101170 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3b0c785-d8f4-48da-91ff-77f16df16053 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:06.103412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3b0c785-d8f4-48da-91ff-77f16df16053 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:06.108426 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b3b0c785-d8f4-48da-91ff-77f16df16053 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:06.890064 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b3b0c785-d8f4-48da-91ff-77f16df16053 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:06.897041 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:20:06.904141 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b3b0c785-d8f4-48da-91ff-77f16df16053 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a" status: 200 len: 1522 microversion: 2.1 time: 0.834758 Oct 01 04:20:06.905759 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 134/251] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:06 2022] GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a => generated 1522 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:06.944571 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-57b5a772-b969-45aa-90c3-aa88ba10d6be tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:06.944846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-36c9290a-4b13-44df-b0d6-cbd2e471f013 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:06.949445 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-57b5a772-b969-45aa-90c3-aa88ba10d6be tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 9b645ab8-978e-40cd-b80d-6c82e666ebb5] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:06.961040 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-36c9290a-4b13-44df-b0d6-cbd2e471f013 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:06.971325 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-36c9290a-4b13-44df-b0d6-cbd2e471f013 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:06.980861 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-36c9290a-4b13-44df-b0d6-cbd2e471f013 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1724 microversion: 2.20 time: 0.965730 Oct 01 04:20:06.985462 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 118/252] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:06 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1724 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:20:07.013413 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57b5a772-b969-45aa-90c3-aa88ba10d6be tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:07.014654 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57b5a772-b969-45aa-90c3-aa88ba10d6be tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:07.016101 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57b5a772-b969-45aa-90c3-aa88ba10d6be tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:07.019511 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57b5a772-b969-45aa-90c3-aa88ba10d6be tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:07.020194 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57b5a772-b969-45aa-90c3-aa88ba10d6be tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:07.020861 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57b5a772-b969-45aa-90c3-aa88ba10d6be tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:07.077859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57b5a772-b969-45aa-90c3-aa88ba10d6be tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:07.079147 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57b5a772-b969-45aa-90c3-aa88ba10d6be tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:07.080149 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57b5a772-b969-45aa-90c3-aa88ba10d6be tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:07.080798 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-57b5a772-b969-45aa-90c3-aa88ba10d6be tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lazy-loading 'fault' on Instance uuid 9b645ab8-978e-40cd-b80d-6c82e666ebb5 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:20:07.188831 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-57b5a772-b969-45aa-90c3-aa88ba10d6be tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27dc4e15e61e44c8905e713a190a45d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6452abdab41846a5915b7ea5d81b9811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:07.205908 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-57b5a772-b969-45aa-90c3-aa88ba10d6be tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5" status: 200 len: 1304 microversion: 2.1 time: 0.279223 Oct 01 04:20:07.228138 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 135/253] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:06 2022] GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5 => generated 1304 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:07.931914 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5dc5610c-2d6a-409f-ad71-20524d5936ff tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:07.938790 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5dc5610c-2d6a-409f-ad71-20524d5936ff tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:07.946538 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5dc5610c-2d6a-409f-ad71-20524d5936ff tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:07.947040 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5dc5610c-2d6a-409f-ad71-20524d5936ff tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:07.947485 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5dc5610c-2d6a-409f-ad71-20524d5936ff tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:07.962433 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5dc5610c-2d6a-409f-ad71-20524d5936ff tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:07.963077 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5dc5610c-2d6a-409f-ad71-20524d5936ff tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:07.963581 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5dc5610c-2d6a-409f-ad71-20524d5936ff tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:08.013242 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dc75f80c-919c-4db9-af0a-6524d6139677 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:08.014055 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dc75f80c-919c-4db9-af0a-6524d6139677 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:08.027929 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc75f80c-919c-4db9-af0a-6524d6139677 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:08.028802 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc75f80c-919c-4db9-af0a-6524d6139677 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:08.029499 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc75f80c-919c-4db9-af0a-6524d6139677 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:08.030889 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc75f80c-919c-4db9-af0a-6524d6139677 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:08.036231 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc75f80c-919c-4db9-af0a-6524d6139677 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:08.037132 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc75f80c-919c-4db9-af0a-6524d6139677 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:08.899086 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-dc75f80c-919c-4db9-af0a-6524d6139677 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:08.914790 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-dc75f80c-919c-4db9-af0a-6524d6139677 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:08.920227 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-dc75f80c-919c-4db9-af0a-6524d6139677 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:08.921685 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dc75f80c-919c-4db9-af0a-6524d6139677 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1724 microversion: 2.20 time: 0.912606 Oct 01 04:20:08.931104 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-5dc5610c-2d6a-409f-ad71-20524d5936ff tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:08.937841 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 136/254] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:08 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1724 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:20:08.939850 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5dc5610c-2d6a-409f-ad71-20524d5936ff tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a" status: 200 len: 1502 microversion: 2.1 time: 1.012052 Oct 01 04:20:08.945412 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 119/255] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:07 2022] GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a => generated 1502 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:08.951284 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-44813542-91b7-4f5e-ae4a-1877cc0c37fd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:20:08.967121 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c26b3ff5-4868-4b0b-abda-a3b4ed541cd4 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:08.967867 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c26b3ff5-4868-4b0b-abda-a3b4ed541cd4 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 9b645ab8-978e-40cd-b80d-6c82e666ebb5] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:08.974115 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-44813542-91b7-4f5e-ae4a-1877cc0c37fd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:08.974881 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-44813542-91b7-4f5e-ae4a-1877cc0c37fd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:08.975494 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-44813542-91b7-4f5e-ae4a-1877cc0c37fd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:08.975631 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c26b3ff5-4868-4b0b-abda-a3b4ed541cd4 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:08.976159 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c26b3ff5-4868-4b0b-abda-a3b4ed541cd4 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:08.976669 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c26b3ff5-4868-4b0b-abda-a3b4ed541cd4 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:08.977569 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c26b3ff5-4868-4b0b-abda-a3b4ed541cd4 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:08.978254 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c26b3ff5-4868-4b0b-abda-a3b4ed541cd4 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:08.979316 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c26b3ff5-4868-4b0b-abda-a3b4ed541cd4 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:09.000572 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-c26b3ff5-4868-4b0b-abda-a3b4ed541cd4 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] HTTP exception thrown: Instance 9b645ab8-978e-40cd-b80d-6c82e666ebb5 could not be found. Oct 01 04:20:09.004586 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c26b3ff5-4868-4b0b-abda-a3b4ed541cd4 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Request method failure captured: Oct 01 04:20:09.004586 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5 HTTP/1.1 Oct 01 04:20:09.004586 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:20:09.004586 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:20:09.004586 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:20:09.004586 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 0 Oct 01 04:20:09.004586 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:20:09.004586 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:20:09.004586 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:20:09.004586 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:20:09.004586 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN7_fPb68k_YYXNwYrRXi9idGSg4PWvCp8eD48khxD-v_HDxJhBGf2fnYt8sljaLN1aAuEpq2qjgWYEbaEpq6xvvOebPr60tzlisu2KyeII73SkKbWF1dicqK-5Wfj18HhbQPVNRk4UZcPzzmO3Sd64RfooL7AZDf1KGDVomPVMa5UF8 Oct 01 04:20:09.004586 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:20:09.004586 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:20:09.004586 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:20:09.004586 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:20:09.004586 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:20:09.004586 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:20:09.004586 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: 6452abdab41846a5915b7ea5d81b9811 Oct 01 04:20:09.004586 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-VolumesActionsTest-1528452928 Oct 01 04:20:09.004586 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:20:09.004586 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:20:09.006387 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6452abdab41846a5915b7ea5d81b9811"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6452abdab41846a5915b7ea5d81b9811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6452abdab41846a5915b7ea5d81b9811"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6452abdab41846a5915b7ea5d81b9811"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:20:09.006387 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-VolumesActionsTest-1528452928 Oct 01 04:20:09.006387 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 6452abdab41846a5915b7ea5d81b9811 Oct 01 04:20:09.006387 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-VolumesActionsTest-1528452928 Oct 01 04:20:09.006387 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-VolumesActionsTest-1528452928-project Oct 01 04:20:09.006387 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:20:09.006387 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:20:09.006387 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: 27dc4e15e61e44c8905e713a190a45d3 Oct 01 04:20:09.006387 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-VolumesActionsTest-1528452928-project Oct 01 04:20:09.006387 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: > Oct 01 04:20:09.006387 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Instance 9b645ab8-978e-40cd-b80d-6c82e666ebb5 could not be found. Oct 01 04:20:09.006387 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'id': '9b645ab8-978e-40cd-b80d-6c82e666ebb5'} Oct 01 04:20:09.007245 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:20:09.007245 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:20:09.007245 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:20:09.007245 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:20:09.007245 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:20:09.007245 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:20:09.007245 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:20:09.007245 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:20:09.007245 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:20:09.007245 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:20:09.007245 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b645ab8-978e-40cd-b80d-6c82e666ebb5 could not be found. Oct 01 04:20:09.007245 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:20:09.007245 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:20:09.007245 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:20:09.007245 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:20:09.007245 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:20:09.007245 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:20:09.007245 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:20:09.007245 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:20:09.007245 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:20:09.008589 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:20:09.008589 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:20:09.008589 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:20:09.008589 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:20:09.008589 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:20:09.008589 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:20:09.008589 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:20:09.008589 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b645ab8-978e-40cd-b80d-6c82e666ebb5 could not be found. Oct 01 04:20:09.008589 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:20:09.008589 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:20:09.008589 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:20:09.008589 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:20:09.008589 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:20:09.008589 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:20:09.008589 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:20:09.008589 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:20:09.008589 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b645ab8-978e-40cd-b80d-6c82e666ebb5 could not be found. Oct 01 04:20:09.008589 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:20:09.021866 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c26b3ff5-4868-4b0b-abda-a3b4ed541cd4 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Returning 404 to user: Instance 9b645ab8-978e-40cd-b80d-6c82e666ebb5 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:20:09.024203 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c26b3ff5-4868-4b0b-abda-a3b4ed541cd4 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5" status: 404 len: 111 microversion: 2.1 time: 0.082080 Oct 01 04:20:09.025970 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 137/256] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:08 2022] GET /compute/v2.1/servers/9b645ab8-978e-40cd-b80d-6c82e666ebb5 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:20:09.047635 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a2e0c278-de1e-40b2-b3d4-00c65d24f980 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a15d2897-ffbb-4fd5-bef6-79315fb2daf9"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:20:09.050856 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a2e0c278-de1e-40b2-b3d4-00c65d24f980 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:09.058963 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2e0c278-de1e-40b2-b3d4-00c65d24f980 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:09.059846 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2e0c278-de1e-40b2-b3d4-00c65d24f980 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:09.060516 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2e0c278-de1e-40b2-b3d4-00c65d24f980 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:09.061877 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2e0c278-de1e-40b2-b3d4-00c65d24f980 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:09.062869 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2e0c278-de1e-40b2-b3d4-00c65d24f980 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:09.063534 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a2e0c278-de1e-40b2-b3d4-00c65d24f980 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:09.127015 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-44813542-91b7-4f5e-ae4a-1877cc0c37fd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Going to try to stop instance {{(pid=120597) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 01 04:20:09.283108 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-44813542-91b7-4f5e-ae4a-1877cc0c37fd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "POST /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69/action" status: 202 len: 0 microversion: 2.1 time: 0.335977 Oct 01 04:20:09.297270 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 120/257] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 1 04:20:08 2022] POST /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 04:20:09.310582 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eb462983-9509-4ce3-99a5-554a28b2f5ed tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:09.312377 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-a2e0c278-de1e-40b2-b3d4-00c65d24f980 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] HTTP exception thrown: Cannot 'attach_volume' instance 2906cc69-afd9-45dd-b846-38782722ed9a while it is in vm_state rescued Oct 01 04:20:09.314429 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a2e0c278-de1e-40b2-b3d4-00c65d24f980 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Request method failure captured: Oct 01 04:20:09.314429 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: POST /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a/os-volume_attachments HTTP/1.1 Oct 01 04:20:09.314429 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:20:09.314429 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:20:09.314429 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:20:09.314429 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 74 Oct 01 04:20:09.314429 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:20:09.314429 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:20:09.314429 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:20:09.314429 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:20:09.314429 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN798A6ygEUFvvEkcfI7qSReKm2UxYzhCs2jYOOZOKUwCn2ocBNad4QsSD0Sc-uPRwf-i9kYKShvHWEgE5cSJRSUVxzLODzJsRfhomt7f51LXA4cAEZPLR8V-qxh0s5PTjrnOKdB2TN8W0JHxgE-z-knV9MsYBlFX3ZzUCq-ESRHWKW8 Oct 01 04:20:09.314429 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:20:09.314429 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:20:09.314429 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:20:09.314429 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:20:09.314429 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:20:09.314429 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:20:09.314429 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: 839c91c5262a49768c3e937b5a034137 Oct 01 04:20:09.314429 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-94604636 Oct 01 04:20:09.314429 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:20:09.314429 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:20:09.316094 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_839c91c5262a49768c3e937b5a034137"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/839c91c5262a49768c3e937b5a034137"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/839c91c5262a49768c3e937b5a034137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/839c91c5262a49768c3e937b5a034137"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:20:09.316094 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-ServerRescueNegativeTestJSON-94604636 Oct 01 04:20:09.316094 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 839c91c5262a49768c3e937b5a034137 Oct 01 04:20:09.316094 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-94604636 Oct 01 04:20:09.316094 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-ServerRescueNegativeTestJSON-94604636-project Oct 01 04:20:09.316094 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:20:09.316094 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:20:09.316094 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: 7014a1defd81461787318bc27d56b9aa Oct 01 04:20:09.316094 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-ServerRescueNegativeTestJSON-94604636-project Oct 01 04:20:09.316094 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Oct 01 04:20:09.316094 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {"volumeAttachment": {"volumeId": "a15d2897-ffbb-4fd5-bef6-79315fb2daf9"}} Oct 01 04:20:09.316094 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: > Oct 01 04:20:09.317049 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Cannot 'attach_volume' instance 2906cc69-afd9-45dd-b846-38782722ed9a while it is in vm_state rescued Oct 01 04:20:09.317049 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'server_id': '2906cc69-afd9-45dd-b846-38782722ed9a', 'body': {'volumeAttachment': {'volumeId': 'a15d2897-ffbb-4fd5-bef6-79315fb2daf9'}}} Oct 01 04:20:09.317049 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:20:09.317049 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:20:09.317049 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 01 04:20:09.317049 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 01 04:20:09.317049 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 01 04:20:09.317049 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 04:20:09.317049 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 01 04:20:09.317049 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 01 04:20:09.317049 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2906cc69-afd9-45dd-b846-38782722ed9a in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 01 04:20:09.317049 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:20:09.317049 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:20:09.317049 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:20:09.317049 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:20:09.317049 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:20:09.317049 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:20:09.317049 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:20:09.317049 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:20:09.318480 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:20:09.318480 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:20:09.318480 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 04:20:09.318480 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 04:20:09.318480 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 04:20:09.318480 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 04:20:09.318480 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 04:20:09.318480 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 04:20:09.318480 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 01 04:20:09.318480 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 01 04:20:09.318480 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 01 04:20:09.318480 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 01 04:20:09.318480 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2906cc69-afd9-45dd-b846-38782722ed9a while it is in vm_state rescued Oct 01 04:20:09.318480 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:20:09.318480 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:20:09.318480 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:20:09.318480 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:20:09.318480 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:20:09.318480 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:20:09.319818 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:20:09.319818 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:20:09.319818 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2906cc69-afd9-45dd-b846-38782722ed9a while it is in vm_state rescued Oct 01 04:20:09.319818 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:20:09.321056 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a2e0c278-de1e-40b2-b3d4-00c65d24f980 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Returning 409 to user: Cannot 'attach_volume' instance 2906cc69-afd9-45dd-b846-38782722ed9a while it is in vm_state rescued {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:20:09.322291 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a2e0c278-de1e-40b2-b3d4-00c65d24f980 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "POST /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.287969 Oct 01 04:20:09.327517 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 138/258] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 1 04:20:09 2022] POST /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a/os-volume_attachments => generated 152 bytes in 294 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 01 04:20:09.333168 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-037612a2-6285-4b0d-9f7d-9b2f337ee4b2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:20:09.333955 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-037612a2-6285-4b0d-9f7d-9b2f337ee4b2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:09.340086 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-eb462983-9509-4ce3-99a5-554a28b2f5ed tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:09.341387 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-037612a2-6285-4b0d-9f7d-9b2f337ee4b2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:09.342230 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-037612a2-6285-4b0d-9f7d-9b2f337ee4b2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:09.342839 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-037612a2-6285-4b0d-9f7d-9b2f337ee4b2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:09.343971 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-037612a2-6285-4b0d-9f7d-9b2f337ee4b2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:09.344605 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-037612a2-6285-4b0d-9f7d-9b2f337ee4b2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:09.345282 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-037612a2-6285-4b0d-9f7d-9b2f337ee4b2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:09.368287 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb462983-9509-4ce3-99a5-554a28b2f5ed tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:09.373657 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb462983-9509-4ce3-99a5-554a28b2f5ed tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:09.374498 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb462983-9509-4ce3-99a5-554a28b2f5ed tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:09.375494 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb462983-9509-4ce3-99a5-554a28b2f5ed tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:09.376201 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb462983-9509-4ce3-99a5-554a28b2f5ed tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:09.376884 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb462983-9509-4ce3-99a5-554a28b2f5ed tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:09.521213 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-037612a2-6285-4b0d-9f7d-9b2f337ee4b2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "POST /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a/action" status: 202 len: 0 microversion: 2.1 time: 0.192040 Oct 01 04:20:09.529760 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 139/259] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 1 04:20:09 2022] POST /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 04:20:09.536564 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bb2ed3f5-40b0-4c05-9cd2-b1336b31ab46 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-872441402", "imageRef": "c63d52d7-4e3d-40cf-a8b5-59a2d027d793", "flavorRef": "452", "networks": [{"uuid": "53afa43e-e4f6-45fd-be82-366552325c26"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:20:09.645673 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-bb2ed3f5-40b0-4c05-9cd2-b1336b31ab46 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] validate_networks() for [('53afa43e-e4f6-45fd-be82-366552325c26', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 04:20:10.470112 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-eb462983-9509-4ce3-99a5-554a28b2f5ed tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:10.482652 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-eb462983-9509-4ce3-99a5-554a28b2f5ed tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1723 microversion: 2.1 time: 1.183675 Oct 01 04:20:10.488354 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 121/260] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:09 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1723 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:10.494341 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b4cc0291-0c0b-4a0d-bf45-49750946c1dd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:10.497103 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b4cc0291-0c0b-4a0d-bf45-49750946c1dd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:10.541335 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4cc0291-0c0b-4a0d-bf45-49750946c1dd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:10.542585 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4cc0291-0c0b-4a0d-bf45-49750946c1dd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:10.544914 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4cc0291-0c0b-4a0d-bf45-49750946c1dd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:10.551816 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4cc0291-0c0b-4a0d-bf45-49750946c1dd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:10.556293 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4cc0291-0c0b-4a0d-bf45-49750946c1dd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:10.558550 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4cc0291-0c0b-4a0d-bf45-49750946c1dd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:11.378674 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-bb2ed3f5-40b0-4c05-9cd2-b1336b31ab46 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 04:20:11.379269 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-bb2ed3f5-40b0-4c05-9cd2-b1336b31ab46 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 04:20:11.379563 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-bb2ed3f5-40b0-4c05-9cd2-b1336b31ab46 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 04:20:11.379975 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-bb2ed3f5-40b0-4c05-9cd2-b1336b31ab46 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 04:20:11.380391 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-bb2ed3f5-40b0-4c05-9cd2-b1336b31ab46 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 04:20:11.390294 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-b4cc0291-0c0b-4a0d-bf45-49750946c1dd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:11.403564 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b4cc0291-0c0b-4a0d-bf45-49750946c1dd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a" status: 200 len: 1510 microversion: 2.1 time: 0.913018 Oct 01 04:20:11.405332 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 122/261] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:10 2022] GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a => generated 1510 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:11.413934 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb2ed3f5-40b0-4c05-9cd2-b1336b31ab46 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:11.421631 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb2ed3f5-40b0-4c05-9cd2-b1336b31ab46 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:11.422388 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb2ed3f5-40b0-4c05-9cd2-b1336b31ab46 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:11.423523 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb2ed3f5-40b0-4c05-9cd2-b1336b31ab46 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:11.424150 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb2ed3f5-40b0-4c05-9cd2-b1336b31ab46 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:11.424752 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb2ed3f5-40b0-4c05-9cd2-b1336b31ab46 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:11.424967 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b3f61dcb-b14e-4e6f-9911-f64fc58ccdec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:11.425913 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b3f61dcb-b14e-4e6f-9911-f64fc58ccdec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:11.444943 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3f61dcb-b14e-4e6f-9911-f64fc58ccdec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:11.445455 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3f61dcb-b14e-4e6f-9911-f64fc58ccdec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:11.445902 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3f61dcb-b14e-4e6f-9911-f64fc58ccdec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:11.446632 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3f61dcb-b14e-4e6f-9911-f64fc58ccdec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:11.447098 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3f61dcb-b14e-4e6f-9911-f64fc58ccdec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:11.447535 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3f61dcb-b14e-4e6f-9911-f64fc58ccdec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:11.498358 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-bb2ed3f5-40b0-4c05-9cd2-b1336b31ab46 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Getting quotas for project 6452abdab41846a5915b7ea5d81b9811. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:20:11.530708 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-bb2ed3f5-40b0-4c05-9cd2-b1336b31ab46 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Getting quotas for user 27dc4e15e61e44c8905e713a190a45d3 and project 6452abdab41846a5915b7ea5d81b9811. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:20:11.570337 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bb2ed3f5-40b0-4c05-9cd2-b1336b31ab46 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 04:20:11.576630 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bb2ed3f5-40b0-4c05-9cd2-b1336b31ab46 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 43214db8-967a-4a0d-938b-85b40b1730da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c63d52d7-4e3d-40cf-a8b5-59a2d027d793',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 04:20:11.695564 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bb2ed3f5-40b0-4c05-9cd2-b1336b31ab46 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.163754 Oct 01 04:20:11.696827 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 140/262] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 1 04:20:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 04:20:11.704859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a0c41b73-3b18-4618-bc14-48c28a5ea49c tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:11.705532 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a0c41b73-3b18-4618-bc14-48c28a5ea49c tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:11.732525 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0c41b73-3b18-4618-bc14-48c28a5ea49c tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:11.733824 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0c41b73-3b18-4618-bc14-48c28a5ea49c tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:11.733824 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0c41b73-3b18-4618-bc14-48c28a5ea49c tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:11.734281 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0c41b73-3b18-4618-bc14-48c28a5ea49c tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:11.734994 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0c41b73-3b18-4618-bc14-48c28a5ea49c tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:11.735899 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0c41b73-3b18-4618-bc14-48c28a5ea49c tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:12.329876 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-b3f61dcb-b14e-4e6f-9911-f64fc58ccdec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:12.345222 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-b3f61dcb-b14e-4e6f-9911-f64fc58ccdec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:12.346733 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-b3f61dcb-b14e-4e6f-9911-f64fc58ccdec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:12.348182 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b3f61dcb-b14e-4e6f-9911-f64fc58ccdec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1724 microversion: 2.20 time: 0.940548 Oct 01 04:20:12.365313 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 123/263] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:11 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1724 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:20:12.382363 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0b086a63-60ac-4857-872a-86ea1f0d3687 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:12.384649 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0b086a63-60ac-4857-872a-86ea1f0d3687 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 43214db8-967a-4a0d-938b-85b40b1730da] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:12.633419 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a0c41b73-3b18-4618-bc14-48c28a5ea49c tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:12.649366 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a0c41b73-3b18-4618-bc14-48c28a5ea49c tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1723 microversion: 2.1 time: 0.951308 Oct 01 04:20:12.654165 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 141/264] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:11 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1723 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:12.659041 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-34ebe6f8-a1c4-4c39-9e6d-ef7071ca7f36 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:12.659662 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-34ebe6f8-a1c4-4c39-9e6d-ef7071ca7f36 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:12.701145 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34ebe6f8-a1c4-4c39-9e6d-ef7071ca7f36 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:12.705301 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34ebe6f8-a1c4-4c39-9e6d-ef7071ca7f36 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:12.705774 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34ebe6f8-a1c4-4c39-9e6d-ef7071ca7f36 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:12.706579 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34ebe6f8-a1c4-4c39-9e6d-ef7071ca7f36 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:12.707109 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34ebe6f8-a1c4-4c39-9e6d-ef7071ca7f36 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:12.708406 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-34ebe6f8-a1c4-4c39-9e6d-ef7071ca7f36 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:12.709451 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-0b086a63-60ac-4857-872a-86ea1f0d3687 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27dc4e15e61e44c8905e713a190a45d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6452abdab41846a5915b7ea5d81b9811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:12.750287 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0b086a63-60ac-4857-872a-86ea1f0d3687 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da" status: 200 len: 1213 microversion: 2.1 time: 0.388121 Oct 01 04:20:12.753654 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 124/265] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:12 2022] GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da => generated 1213 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:13.370337 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-34ebe6f8-a1c4-4c39-9e6d-ef7071ca7f36 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:13.381897 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-13ec6cf7-c00f-4121-bc3f-c481609590b5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:13.382594 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-13ec6cf7-c00f-4121-bc3f-c481609590b5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:13.406345 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-34ebe6f8-a1c4-4c39-9e6d-ef7071ca7f36 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a" status: 200 len: 1510 microversion: 2.1 time: 0.751035 Oct 01 04:20:13.420841 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13ec6cf7-c00f-4121-bc3f-c481609590b5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:13.429337 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 142/266] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:12 2022] GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a => generated 1510 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:13.429772 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13ec6cf7-c00f-4121-bc3f-c481609590b5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:13.430315 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13ec6cf7-c00f-4121-bc3f-c481609590b5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:13.431080 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13ec6cf7-c00f-4121-bc3f-c481609590b5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:13.434564 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13ec6cf7-c00f-4121-bc3f-c481609590b5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:13.435006 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-13ec6cf7-c00f-4121-bc3f-c481609590b5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:13.681519 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-237e2c68-3120-473d-8d9f-456f62dffc50 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:13.682597 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-237e2c68-3120-473d-8d9f-456f62dffc50 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:13.699830 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-237e2c68-3120-473d-8d9f-456f62dffc50 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:13.701899 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-237e2c68-3120-473d-8d9f-456f62dffc50 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:13.702926 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-237e2c68-3120-473d-8d9f-456f62dffc50 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:13.708197 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-237e2c68-3120-473d-8d9f-456f62dffc50 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:13.710702 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-237e2c68-3120-473d-8d9f-456f62dffc50 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:13.714735 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-237e2c68-3120-473d-8d9f-456f62dffc50 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:14.267280 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-237e2c68-3120-473d-8d9f-456f62dffc50 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:14.304892 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-237e2c68-3120-473d-8d9f-456f62dffc50 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1723 microversion: 2.1 time: 0.628769 Oct 01 04:20:14.315738 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 143/267] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:13 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1723 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:20:14.330569 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-abdfd76e-6244-41ef-8f06-2da6698d4e72 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:14.332718 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-abdfd76e-6244-41ef-8f06-2da6698d4e72 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 43214db8-967a-4a0d-938b-85b40b1730da] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:14.340301 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-13ec6cf7-c00f-4121-bc3f-c481609590b5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:14.344892 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abdfd76e-6244-41ef-8f06-2da6698d4e72 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:14.345648 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abdfd76e-6244-41ef-8f06-2da6698d4e72 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:14.346018 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abdfd76e-6244-41ef-8f06-2da6698d4e72 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:14.347524 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abdfd76e-6244-41ef-8f06-2da6698d4e72 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:14.348281 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abdfd76e-6244-41ef-8f06-2da6698d4e72 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:14.349050 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abdfd76e-6244-41ef-8f06-2da6698d4e72 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:14.396243 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-13ec6cf7-c00f-4121-bc3f-c481609590b5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:14.400322 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-13ec6cf7-c00f-4121-bc3f-c481609590b5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:14.408630 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-13ec6cf7-c00f-4121-bc3f-c481609590b5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1745 microversion: 2.20 time: 1.032988 Oct 01 04:20:14.411599 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 125/268] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:13 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1745 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:20:14.453133 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9680b712-a4c7-4c0f-a2fa-bad8d20aa765 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:14.454014 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9680b712-a4c7-4c0f-a2fa-bad8d20aa765 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:14.467614 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9680b712-a4c7-4c0f-a2fa-bad8d20aa765 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:14.468695 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9680b712-a4c7-4c0f-a2fa-bad8d20aa765 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:14.469807 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9680b712-a4c7-4c0f-a2fa-bad8d20aa765 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:14.470926 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9680b712-a4c7-4c0f-a2fa-bad8d20aa765 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:14.475339 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9680b712-a4c7-4c0f-a2fa-bad8d20aa765 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:14.476083 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9680b712-a4c7-4c0f-a2fa-bad8d20aa765 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:14.523364 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-abdfd76e-6244-41ef-8f06-2da6698d4e72 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27dc4e15e61e44c8905e713a190a45d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6452abdab41846a5915b7ea5d81b9811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:14.534535 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-abdfd76e-6244-41ef-8f06-2da6698d4e72 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da" status: 200 len: 1265 microversion: 2.1 time: 0.217595 Oct 01 04:20:14.537604 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 144/269] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:14 2022] GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:14.544224 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:20:14.909487 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-9680b712-a4c7-4c0f-a2fa-bad8d20aa765 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:14.922202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9680b712-a4c7-4c0f-a2fa-bad8d20aa765 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a" status: 200 len: 1516 microversion: 2.1 time: 0.474449 Oct 01 04:20:14.926619 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 126/270] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:14 2022] GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a => generated 1516 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:15.339087 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f6f6c666-d887-49cb-8ba2-d6ea361d3401 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:15.340126 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f6f6c666-d887-49cb-8ba2-d6ea361d3401 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:15.356805 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6f6c666-d887-49cb-8ba2-d6ea361d3401 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:15.358048 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6f6c666-d887-49cb-8ba2-d6ea361d3401 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:15.358554 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6f6c666-d887-49cb-8ba2-d6ea361d3401 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:15.359304 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6f6c666-d887-49cb-8ba2-d6ea361d3401 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:15.376395 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6f6c666-d887-49cb-8ba2-d6ea361d3401 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:15.377070 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6f6c666-d887-49cb-8ba2-d6ea361d3401 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:15.451804 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c20bd89e-e972-47df-b085-1bee53af244d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:15.452551 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c20bd89e-e972-47df-b085-1bee53af244d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:15.472767 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c20bd89e-e972-47df-b085-1bee53af244d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:15.474072 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c20bd89e-e972-47df-b085-1bee53af244d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:15.477453 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c20bd89e-e972-47df-b085-1bee53af244d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:15.478269 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c20bd89e-e972-47df-b085-1bee53af244d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:15.479365 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c20bd89e-e972-47df-b085-1bee53af244d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:15.479716 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c20bd89e-e972-47df-b085-1bee53af244d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:15.821936 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f6f6c666-d887-49cb-8ba2-d6ea361d3401 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:15.849761 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c20bd89e-e972-47df-b085-1bee53af244d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:15.851226 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f6f6c666-d887-49cb-8ba2-d6ea361d3401 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1723 microversion: 2.1 time: 0.517709 Oct 01 04:20:15.857505 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 145/271] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:15 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1723 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:15.864287 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c20bd89e-e972-47df-b085-1bee53af244d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:15.869769 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b348ab59-6a40-4305-bfd5-8fe7db93d248 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:15.871234 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c20bd89e-e972-47df-b085-1bee53af244d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:15.871711 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b348ab59-6a40-4305-bfd5-8fe7db93d248 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 43214db8-967a-4a0d-938b-85b40b1730da] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:15.875693 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c20bd89e-e972-47df-b085-1bee53af244d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1745 microversion: 2.20 time: 0.426751 Oct 01 04:20:15.876818 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 127/272] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:15 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1745 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:20:15.883923 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b348ab59-6a40-4305-bfd5-8fe7db93d248 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:15.886361 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b348ab59-6a40-4305-bfd5-8fe7db93d248 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:15.888543 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b348ab59-6a40-4305-bfd5-8fe7db93d248 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:15.889991 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b348ab59-6a40-4305-bfd5-8fe7db93d248 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:15.893236 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b348ab59-6a40-4305-bfd5-8fe7db93d248 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:15.893956 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b348ab59-6a40-4305-bfd5-8fe7db93d248 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:16.052216 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b348ab59-6a40-4305-bfd5-8fe7db93d248 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27dc4e15e61e44c8905e713a190a45d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6452abdab41846a5915b7ea5d81b9811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:16.065820 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b348ab59-6a40-4305-bfd5-8fe7db93d248 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da" status: 200 len: 1271 microversion: 2.1 time: 0.206691 Oct 01 04:20:16.082442 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 146/273] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:15 2022] GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da => generated 1271 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:16.684294 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-31b11392-237e-416f-9aa5-fd2f7cd0bd25 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Action: 'create', calling method: .version_select at 0x7fdfbe9f0430>, body: {"keypair": {"name": "tempest-keypair-1526214309", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGI9zsvGCDZyYgT7hNBb8SAOoNcLtIJaHqk4rTO4ZL+RaxhsGiFvtRJkurDvIhu9ixS4TUrEFVypjzboGwyUWS3YBu9XasIHRjktgNakibLtGb0kbQMbYlTTgKJ9x2NOPA=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:20:16.750919 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-31b11392-237e-416f-9aa5-fd2f7cd0bd25 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Getting quotas for project 839c91c5262a49768c3e937b5a034137. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:20:16.762264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-31b11392-237e-416f-9aa5-fd2f7cd0bd25 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Getting quotas for user 7014a1defd81461787318bc27d56b9aa and project 839c91c5262a49768c3e937b5a034137. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:20:16.862178 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-31b11392-237e-416f-9aa5-fd2f7cd0bd25 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.183658 Oct 01 04:20:16.864672 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 128/274] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 1 04:20:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:20:16.895931 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-948e6dc6-7419-48ee-a788-67bbcc2e0050 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:16.896609 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-948e6dc6-7419-48ee-a788-67bbcc2e0050 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:16.915291 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d576e79b-b57d-4552-b910-ac6ec8eb7b6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:16.915918 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d576e79b-b57d-4552-b910-ac6ec8eb7b6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:16.930101 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d576e79b-b57d-4552-b910-ac6ec8eb7b6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:16.931830 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d576e79b-b57d-4552-b910-ac6ec8eb7b6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:16.932623 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d576e79b-b57d-4552-b910-ac6ec8eb7b6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:16.933838 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-948e6dc6-7419-48ee-a788-67bbcc2e0050 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:16.934338 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-948e6dc6-7419-48ee-a788-67bbcc2e0050 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:16.934803 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-948e6dc6-7419-48ee-a788-67bbcc2e0050 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:16.935702 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d576e79b-b57d-4552-b910-ac6ec8eb7b6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:16.936175 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d576e79b-b57d-4552-b910-ac6ec8eb7b6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:16.936603 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d576e79b-b57d-4552-b910-ac6ec8eb7b6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:16.937861 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-948e6dc6-7419-48ee-a788-67bbcc2e0050 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:16.939414 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-948e6dc6-7419-48ee-a788-67bbcc2e0050 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:16.939860 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-948e6dc6-7419-48ee-a788-67bbcc2e0050 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:17.584549 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-948e6dc6-7419-48ee-a788-67bbcc2e0050 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:17.605657 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-948e6dc6-7419-48ee-a788-67bbcc2e0050 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1723 microversion: 2.1 time: 0.718930 Oct 01 04:20:17.607699 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 147/275] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:16 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1723 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:17.620787 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ba25bb06-77b0-43d3-a1eb-2e8b40be41b8 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:17.633429 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ba25bb06-77b0-43d3-a1eb-2e8b40be41b8 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 43214db8-967a-4a0d-938b-85b40b1730da] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:17.673097 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba25bb06-77b0-43d3-a1eb-2e8b40be41b8 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:17.684100 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba25bb06-77b0-43d3-a1eb-2e8b40be41b8 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:17.686937 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba25bb06-77b0-43d3-a1eb-2e8b40be41b8 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:17.690552 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba25bb06-77b0-43d3-a1eb-2e8b40be41b8 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:17.693982 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba25bb06-77b0-43d3-a1eb-2e8b40be41b8 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:17.702209 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ba25bb06-77b0-43d3-a1eb-2e8b40be41b8 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:17.753004 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-d576e79b-b57d-4552-b910-ac6ec8eb7b6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:17.772617 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-d576e79b-b57d-4552-b910-ac6ec8eb7b6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:17.775075 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-d576e79b-b57d-4552-b910-ac6ec8eb7b6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:17.781330 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d576e79b-b57d-4552-b910-ac6ec8eb7b6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1740 microversion: 2.20 time: 0.873187 Oct 01 04:20:17.802272 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 129/276] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:16 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1740 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:20:18.070893 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-934f20d1-21a9-42a3-9ce5-d1905a4abef1 req-c5fcd858-8808-4744-87f7-c85f6aaf88a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e14e3570-67e7-43d6-bcaf-6688168956b2", "name": "network-vif-plugged", "status": "completed", "tag": "28ed6420-e14b-48a2-a448-a8ab736b93af"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:20:18.092105 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ba25bb06-77b0-43d3-a1eb-2e8b40be41b8 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27dc4e15e61e44c8905e713a190a45d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6452abdab41846a5915b7ea5d81b9811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:18.110417 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-934f20d1-21a9-42a3-9ce5-d1905a4abef1 req-c5fcd858-8808-4744-87f7-c85f6aaf88a6 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:18.111105 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-934f20d1-21a9-42a3-9ce5-d1905a4abef1 req-c5fcd858-8808-4744-87f7-c85f6aaf88a6 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:18.111690 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-934f20d1-21a9-42a3-9ce5-d1905a4abef1 req-c5fcd858-8808-4744-87f7-c85f6aaf88a6 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:18.112649 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ba25bb06-77b0-43d3-a1eb-2e8b40be41b8 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da" status: 200 len: 1313 microversion: 2.1 time: 0.503426 Oct 01 04:20:18.115227 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 148/277] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:17 2022] GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da => generated 1313 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:18.139834 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-934f20d1-21a9-42a3-9ce5-d1905a4abef1 req-c5fcd858-8808-4744-87f7-c85f6aaf88a6 service nova] Creating event network-vif-plugged:28ed6420-e14b-48a2-a448-a8ab736b93af for instance e14e3570-67e7-43d6-bcaf-6688168956b2 on hv-cinder-86004 Oct 01 04:20:18.158571 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-934f20d1-21a9-42a3-9ce5-d1905a4abef1 req-c5fcd858-8808-4744-87f7-c85f6aaf88a6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091199 Oct 01 04:20:18.163431 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 130/278] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:20:18.633766 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-18f080ff-4735-435a-ba3e-251bafd7e7d1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:18.634844 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-18f080ff-4735-435a-ba3e-251bafd7e7d1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:18.646418 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18f080ff-4735-435a-ba3e-251bafd7e7d1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:18.651531 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18f080ff-4735-435a-ba3e-251bafd7e7d1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:18.654321 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18f080ff-4735-435a-ba3e-251bafd7e7d1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:18.655195 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18f080ff-4735-435a-ba3e-251bafd7e7d1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:18.656620 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18f080ff-4735-435a-ba3e-251bafd7e7d1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:18.658896 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18f080ff-4735-435a-ba3e-251bafd7e7d1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:18.832811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6c2de82f-7e13-4228-8917-4a5f327857a3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:18.833564 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6c2de82f-7e13-4228-8917-4a5f327857a3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:18.863758 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c2de82f-7e13-4228-8917-4a5f327857a3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:18.864261 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c2de82f-7e13-4228-8917-4a5f327857a3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:18.864705 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c2de82f-7e13-4228-8917-4a5f327857a3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:18.865770 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c2de82f-7e13-4228-8917-4a5f327857a3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:18.865916 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c2de82f-7e13-4228-8917-4a5f327857a3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:18.876819 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6c2de82f-7e13-4228-8917-4a5f327857a3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:20.247092 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-18f080ff-4735-435a-ba3e-251bafd7e7d1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:20.267351 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-18f080ff-4735-435a-ba3e-251bafd7e7d1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1723 microversion: 2.1 time: 1.637368 Oct 01 04:20:20.270715 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 149/279] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:18 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1723 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:20.296624 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3bb9d095-a1e0-48c3-a663-37dc4344479c tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:20.299310 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3bb9d095-a1e0-48c3-a663-37dc4344479c tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 43214db8-967a-4a0d-938b-85b40b1730da] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:20.321482 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bb9d095-a1e0-48c3-a663-37dc4344479c tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:20.322410 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bb9d095-a1e0-48c3-a663-37dc4344479c tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:20.323463 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bb9d095-a1e0-48c3-a663-37dc4344479c tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:20.324365 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bb9d095-a1e0-48c3-a663-37dc4344479c tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:20.325611 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bb9d095-a1e0-48c3-a663-37dc4344479c tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:20.326915 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3bb9d095-a1e0-48c3-a663-37dc4344479c tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:20.336456 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-6c2de82f-7e13-4228-8917-4a5f327857a3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:20.351392 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-6c2de82f-7e13-4228-8917-4a5f327857a3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:20.362779 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-6c2de82f-7e13-4228-8917-4a5f327857a3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:20.364517 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6c2de82f-7e13-4228-8917-4a5f327857a3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1740 microversion: 2.20 time: 1.549503 Oct 01 04:20:20.374024 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 131/280] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:18 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1740 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:20:20.615791 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-c5e17737-e255-4c71-9b84-4cb66b465be5 req-a42e1ddd-7d35-4525-bea0-44cd631f60ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43214db8-967a-4a0d-938b-85b40b1730da", "tag": "7136ea86-24d8-4389-94ab-9649799d8818"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:20:20.647921 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c5e17737-e255-4c71-9b84-4cb66b465be5 req-a42e1ddd-7d35-4525-bea0-44cd631f60ea service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:20.654230 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c5e17737-e255-4c71-9b84-4cb66b465be5 req-a42e1ddd-7d35-4525-bea0-44cd631f60ea service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:20.654921 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c5e17737-e255-4c71-9b84-4cb66b465be5 req-a42e1ddd-7d35-4525-bea0-44cd631f60ea service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:20.692833 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-c5e17737-e255-4c71-9b84-4cb66b465be5 req-a42e1ddd-7d35-4525-bea0-44cd631f60ea service nova] Creating event network-changed:7136ea86-24d8-4389-94ab-9649799d8818 for instance 43214db8-967a-4a0d-938b-85b40b1730da on hv-cinder-86004 Oct 01 04:20:20.708999 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-c5e17737-e255-4c71-9b84-4cb66b465be5 req-a42e1ddd-7d35-4525-bea0-44cd631f60ea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096779 Oct 01 04:20:20.709990 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 132/281] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:20:20.932202 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-3bb9d095-a1e0-48c3-a663-37dc4344479c tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27dc4e15e61e44c8905e713a190a45d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6452abdab41846a5915b7ea5d81b9811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:20.943168 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3bb9d095-a1e0-48c3-a663-37dc4344479c tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da" status: 200 len: 1313 microversion: 2.1 time: 0.668574 Oct 01 04:20:20.944378 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 150/282] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:20 2022] GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da => generated 1313 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:21.303051 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-22b90983-b702-41ab-8515-7a74b335a6a2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:21.303901 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-22b90983-b702-41ab-8515-7a74b335a6a2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:21.320744 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22b90983-b702-41ab-8515-7a74b335a6a2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:21.321752 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22b90983-b702-41ab-8515-7a74b335a6a2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:21.322471 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22b90983-b702-41ab-8515-7a74b335a6a2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:21.324387 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22b90983-b702-41ab-8515-7a74b335a6a2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:21.325158 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22b90983-b702-41ab-8515-7a74b335a6a2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:21.331859 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22b90983-b702-41ab-8515-7a74b335a6a2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:21.399143 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-496e0393-122d-4efc-bfbd-b7a6d8aed50c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:21.400259 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-496e0393-122d-4efc-bfbd-b7a6d8aed50c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:21.413902 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-496e0393-122d-4efc-bfbd-b7a6d8aed50c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:21.417747 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-496e0393-122d-4efc-bfbd-b7a6d8aed50c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:21.418529 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-496e0393-122d-4efc-bfbd-b7a6d8aed50c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:21.419515 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-496e0393-122d-4efc-bfbd-b7a6d8aed50c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:21.423329 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-496e0393-122d-4efc-bfbd-b7a6d8aed50c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:21.424327 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-496e0393-122d-4efc-bfbd-b7a6d8aed50c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:21.486105 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:20:21.557692 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:20:22.027487 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-496e0393-122d-4efc-bfbd-b7a6d8aed50c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:22.031009 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:20:22.060227 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-496e0393-122d-4efc-bfbd-b7a6d8aed50c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:22.062260 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-496e0393-122d-4efc-bfbd-b7a6d8aed50c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:22.070477 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-496e0393-122d-4efc-bfbd-b7a6d8aed50c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1740 microversion: 2.20 time: 0.675137 Oct 01 04:20:22.074517 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 151/283] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:21 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1740 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:20:22.086775 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4e6100af-35f1-4503-a6de-63c382cb057d tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:22.089730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4e6100af-35f1-4503-a6de-63c382cb057d tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 43214db8-967a-4a0d-938b-85b40b1730da] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:22.120841 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e6100af-35f1-4503-a6de-63c382cb057d tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:22.128249 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e6100af-35f1-4503-a6de-63c382cb057d tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:22.130634 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e6100af-35f1-4503-a6de-63c382cb057d tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:22.134444 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e6100af-35f1-4503-a6de-63c382cb057d tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:22.135303 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e6100af-35f1-4503-a6de-63c382cb057d tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:22.141626 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4e6100af-35f1-4503-a6de-63c382cb057d tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:22.179050 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-22b90983-b702-41ab-8515-7a74b335a6a2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:22.195514 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-22b90983-b702-41ab-8515-7a74b335a6a2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1700 microversion: 2.1 time: 0.904300 Oct 01 04:20:22.198532 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 133/284] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:21 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1700 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:22.224773 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-21fa21a1-f52c-4b1c-8f95-796c6245223c tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:20:22.258937 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-21fa21a1-f52c-4b1c-8f95-796c6245223c tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:22.261122 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-21fa21a1-f52c-4b1c-8f95-796c6245223c tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:22.262576 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-21fa21a1-f52c-4b1c-8f95-796c6245223c tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:22.316050 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-21fa21a1-f52c-4b1c-8f95-796c6245223c tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Going to try to start instance {{(pid=120597) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 01 04:20:22.477265 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-21fa21a1-f52c-4b1c-8f95-796c6245223c tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "POST /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69/action" status: 202 len: 0 microversion: 2.1 time: 0.241194 Oct 01 04:20:22.485941 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 134/285] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 1 04:20:22 2022] POST /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 01 04:20:22.528242 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eedcc90a-7971-41fc-b111-2591b34341e5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:22.540773 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-eedcc90a-7971-41fc-b111-2591b34341e5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:22.580311 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eedcc90a-7971-41fc-b111-2591b34341e5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:22.586443 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eedcc90a-7971-41fc-b111-2591b34341e5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:22.591762 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eedcc90a-7971-41fc-b111-2591b34341e5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:22.595692 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eedcc90a-7971-41fc-b111-2591b34341e5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:22.596790 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eedcc90a-7971-41fc-b111-2591b34341e5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:22.601909 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eedcc90a-7971-41fc-b111-2591b34341e5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:23.051641 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4e6100af-35f1-4503-a6de-63c382cb057d tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27dc4e15e61e44c8905e713a190a45d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6452abdab41846a5915b7ea5d81b9811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:23.066455 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4e6100af-35f1-4503-a6de-63c382cb057d tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da" status: 200 len: 1313 microversion: 2.1 time: 0.986673 Oct 01 04:20:23.068368 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 152/286] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:22 2022] GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da => generated 1313 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:23.079945 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b52a1c34-b016-4e79-97d1-89abe029d5ce tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-366972789", "imageRef": "c63d52d7-4e3d-40cf-a8b5-59a2d027d793", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e21d865-d526-49ca-8e76-21cf583604c4"}], "security_groups": [{"name": "tempest-securitygroup--815724258"}], "key_name": "tempest-keypair-1526214309", "user_data": "}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:20:23.271827 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-eedcc90a-7971-41fc-b111-2591b34341e5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:23.286363 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-eedcc90a-7971-41fc-b111-2591b34341e5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1709 microversion: 2.1 time: 0.788657 Oct 01 04:20:23.309001 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 135/287] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:22 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1709 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:23.328242 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-042cd805-7ca3-4b71-9575-47c70a2f0692 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:23.332396 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-042cd805-7ca3-4b71-9575-47c70a2f0692 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:23.357337 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-042cd805-7ca3-4b71-9575-47c70a2f0692 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:23.357850 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-042cd805-7ca3-4b71-9575-47c70a2f0692 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:23.358292 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-042cd805-7ca3-4b71-9575-47c70a2f0692 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:23.359023 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-042cd805-7ca3-4b71-9575-47c70a2f0692 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:23.361485 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-042cd805-7ca3-4b71-9575-47c70a2f0692 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:23.362148 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-042cd805-7ca3-4b71-9575-47c70a2f0692 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:23.668399 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-042cd805-7ca3-4b71-9575-47c70a2f0692 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:23.681291 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-042cd805-7ca3-4b71-9575-47c70a2f0692 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:23.683495 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-042cd805-7ca3-4b71-9575-47c70a2f0692 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:23.687404 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-042cd805-7ca3-4b71-9575-47c70a2f0692 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1740 microversion: 2.20 time: 0.377283 Oct 01 04:20:23.690982 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 136/288] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:23 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1740 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:20:24.091739 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c0b23d67-61af-48a6-8418-8cebf852c340 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:24.092549 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c0b23d67-61af-48a6-8418-8cebf852c340 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 43214db8-967a-4a0d-938b-85b40b1730da] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:24.102653 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0b23d67-61af-48a6-8418-8cebf852c340 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:24.105243 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0b23d67-61af-48a6-8418-8cebf852c340 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:24.106849 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0b23d67-61af-48a6-8418-8cebf852c340 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:24.112057 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0b23d67-61af-48a6-8418-8cebf852c340 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:24.112865 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0b23d67-61af-48a6-8418-8cebf852c340 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:24.115915 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0b23d67-61af-48a6-8418-8cebf852c340 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:24.871052 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c0b23d67-61af-48a6-8418-8cebf852c340 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27dc4e15e61e44c8905e713a190a45d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6452abdab41846a5915b7ea5d81b9811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:24.890447 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c0b23d67-61af-48a6-8418-8cebf852c340 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da" status: 200 len: 1313 microversion: 2.1 time: 0.803098 Oct 01 04:20:24.891718 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 137/289] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:24 2022] GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da => generated 1313 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:24.903880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2e8cede1-5752-4d07-8872-ed489db62575 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:24.904703 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2e8cede1-5752-4d07-8872-ed489db62575 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:24.925834 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e8cede1-5752-4d07-8872-ed489db62575 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:24.926617 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e8cede1-5752-4d07-8872-ed489db62575 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:24.928090 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e8cede1-5752-4d07-8872-ed489db62575 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:24.929378 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e8cede1-5752-4d07-8872-ed489db62575 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:24.929996 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e8cede1-5752-4d07-8872-ed489db62575 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:24.930575 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e8cede1-5752-4d07-8872-ed489db62575 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:25.855156 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-2e8cede1-5752-4d07-8872-ed489db62575 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:25.871126 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2e8cede1-5752-4d07-8872-ed489db62575 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1709 microversion: 2.1 time: 0.977011 Oct 01 04:20:25.878011 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 138/290] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:24 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1709 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:25.895671 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-29c776e0-27d9-4ae1-bf26-476f8f6a1915 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:25.905865 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-29c776e0-27d9-4ae1-bf26-476f8f6a1915 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:25.928435 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29c776e0-27d9-4ae1-bf26-476f8f6a1915 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:25.929273 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29c776e0-27d9-4ae1-bf26-476f8f6a1915 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:25.929889 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29c776e0-27d9-4ae1-bf26-476f8f6a1915 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:25.930785 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29c776e0-27d9-4ae1-bf26-476f8f6a1915 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:25.931575 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29c776e0-27d9-4ae1-bf26-476f8f6a1915 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:25.932293 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-29c776e0-27d9-4ae1-bf26-476f8f6a1915 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:26.415544 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-29c776e0-27d9-4ae1-bf26-476f8f6a1915 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:26.427377 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-29c776e0-27d9-4ae1-bf26-476f8f6a1915 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:26.433283 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-29c776e0-27d9-4ae1-bf26-476f8f6a1915 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:26.434752 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-29c776e0-27d9-4ae1-bf26-476f8f6a1915 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1740 microversion: 2.20 time: 0.551774 Oct 01 04:20:26.437240 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 139/291] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:25 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1740 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:20:26.469036 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7cffd2bc-4b5a-46e7-ad73-41a7fbbc35d1 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:26.469775 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7cffd2bc-4b5a-46e7-ad73-41a7fbbc35d1 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 43214db8-967a-4a0d-938b-85b40b1730da] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:26.479243 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7cffd2bc-4b5a-46e7-ad73-41a7fbbc35d1 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:26.479902 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7cffd2bc-4b5a-46e7-ad73-41a7fbbc35d1 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:26.484435 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7cffd2bc-4b5a-46e7-ad73-41a7fbbc35d1 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:26.486274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7cffd2bc-4b5a-46e7-ad73-41a7fbbc35d1 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:26.496375 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7cffd2bc-4b5a-46e7-ad73-41a7fbbc35d1 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:26.496980 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7cffd2bc-4b5a-46e7-ad73-41a7fbbc35d1 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:26.804603 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:20:27.096804 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-7cffd2bc-4b5a-46e7-ad73-41a7fbbc35d1 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27dc4e15e61e44c8905e713a190a45d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6452abdab41846a5915b7ea5d81b9811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:27.119680 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7cffd2bc-4b5a-46e7-ad73-41a7fbbc35d1 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da" status: 200 len: 1313 microversion: 2.1 time: 0.662331 Oct 01 04:20:27.193797 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 140/292] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:26 2022] GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da => generated 1313 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:27.201600 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-57fa43d2-f36f-445c-ab6e-bccee04de421 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:27.202679 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-57fa43d2-f36f-445c-ab6e-bccee04de421 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:27.215244 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57fa43d2-f36f-445c-ab6e-bccee04de421 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:27.233954 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57fa43d2-f36f-445c-ab6e-bccee04de421 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:27.234743 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57fa43d2-f36f-445c-ab6e-bccee04de421 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:27.235745 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57fa43d2-f36f-445c-ab6e-bccee04de421 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:27.236433 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57fa43d2-f36f-445c-ab6e-bccee04de421 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:27.237154 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57fa43d2-f36f-445c-ab6e-bccee04de421 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:27.736938 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-57fa43d2-f36f-445c-ab6e-bccee04de421 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:27.752780 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-57fa43d2-f36f-445c-ab6e-bccee04de421 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1713 microversion: 2.1 time: 0.557340 Oct 01 04:20:27.753414 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 141/293] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:27 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1713 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:27.778675 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a529b444-1a24-48f8-b148-51df18e24473 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:27.779548 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a529b444-1a24-48f8-b148-51df18e24473 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:27.808709 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a529b444-1a24-48f8-b148-51df18e24473 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:27.814878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a529b444-1a24-48f8-b148-51df18e24473 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:27.815475 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a529b444-1a24-48f8-b148-51df18e24473 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:27.816339 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a529b444-1a24-48f8-b148-51df18e24473 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:27.816915 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a529b444-1a24-48f8-b148-51df18e24473 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:27.817472 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a529b444-1a24-48f8-b148-51df18e24473 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:28.356523 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-a529b444-1a24-48f8-b148-51df18e24473 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:28.378944 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-a529b444-1a24-48f8-b148-51df18e24473 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:28.380657 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-a529b444-1a24-48f8-b148-51df18e24473 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:28.382336 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a529b444-1a24-48f8-b148-51df18e24473 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1740 microversion: 2.20 time: 0.614157 Oct 01 04:20:28.383440 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 142/294] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:27 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1740 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:20:28.391911 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-a43b9805-2766-43b9-8b26-5bff1aaed54c req-736bd69b-86ed-42cc-b02e-b1a76e835be7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43214db8-967a-4a0d-938b-85b40b1730da", "name": "network-vif-plugged", "status": "completed", "tag": "7136ea86-24d8-4389-94ab-9649799d8818"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:20:28.418830 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a43b9805-2766-43b9-8b26-5bff1aaed54c req-736bd69b-86ed-42cc-b02e-b1a76e835be7 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:28.425714 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a43b9805-2766-43b9-8b26-5bff1aaed54c req-736bd69b-86ed-42cc-b02e-b1a76e835be7 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:28.427330 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a43b9805-2766-43b9-8b26-5bff1aaed54c req-736bd69b-86ed-42cc-b02e-b1a76e835be7 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:28.450172 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-a43b9805-2766-43b9-8b26-5bff1aaed54c req-736bd69b-86ed-42cc-b02e-b1a76e835be7 service nova] Creating event network-vif-plugged:7136ea86-24d8-4389-94ab-9649799d8818 for instance 43214db8-967a-4a0d-938b-85b40b1730da on hv-cinder-86004 Oct 01 04:20:28.461157 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-a43b9805-2766-43b9-8b26-5bff1aaed54c req-736bd69b-86ed-42cc-b02e-b1a76e835be7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073848 Oct 01 04:20:28.462796 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 143/295] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:20:28.473657 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-39d484fd-7043-4b37-95d4-88146978e5b3 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:28.475022 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-39d484fd-7043-4b37-95d4-88146978e5b3 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 43214db8-967a-4a0d-938b-85b40b1730da] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:28.485767 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39d484fd-7043-4b37-95d4-88146978e5b3 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:28.486666 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39d484fd-7043-4b37-95d4-88146978e5b3 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:28.487719 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39d484fd-7043-4b37-95d4-88146978e5b3 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:28.489526 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39d484fd-7043-4b37-95d4-88146978e5b3 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:28.490606 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39d484fd-7043-4b37-95d4-88146978e5b3 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:28.491318 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39d484fd-7043-4b37-95d4-88146978e5b3 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:28.817060 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-39d484fd-7043-4b37-95d4-88146978e5b3 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27dc4e15e61e44c8905e713a190a45d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6452abdab41846a5915b7ea5d81b9811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:28.842022 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-39d484fd-7043-4b37-95d4-88146978e5b3 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da" status: 200 len: 1313 microversion: 2.1 time: 0.376654 Oct 01 04:20:28.842878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 144/296] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:28 2022] GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da => generated 1313 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:28.849174 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b1e4a56f-6102-4b7e-9c9b-cd3363b7c80d tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Action: 'create', calling method: .version_select at 0x7fdfbe9f0430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-593196368", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISiu66s7YhntpJ7x2HGGF65/5Z4TIJXnsT8tC8HELV5DNlOF41KCSmEDFcLtVTtkRwDhgQHjMfxJacITtFwbkfGBUXXphIae9svSyHcKL7rQF7ih/pW6kQxkO+VR7PLWw=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:20:28.906174 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:20:28.931325 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-b1e4a56f-6102-4b7e-9c9b-cd3363b7c80d tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Getting quotas for project 1d29e2e750f948e1b0ccd4117c0d347a. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:20:28.949123 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-b1e4a56f-6102-4b7e-9c9b-cd3363b7c80d tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Getting quotas for user 3d75f6b795064e00b20207e6cfc22cf1 and project 1d29e2e750f948e1b0ccd4117c0d347a. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:20:28.960528 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-b52a1c34-b016-4e79-97d1-89abe029d5ce tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] validate_networks() for [('9e21d865-d526-49ca-8e76-21cf583604c4', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 04:20:28.977712 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b1e4a56f-6102-4b7e-9c9b-cd3363b7c80d tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.133726 Oct 01 04:20:28.979186 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 145/297] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 1 04:20:28 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:20:29.344312 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4a52bd6c-77e3-446f-85f0-9b3714be1396 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Action: 'create', calling method: .version_select at 0x7fdfbe94a550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1277045486", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGonTru62Mkb4ZI+TBlxL84MZ3jrbVvvUi6dX/EXxvjpQGPZHeV+D/a2xsyOVBDdlf5VL2QpTdhjkZMqsomTVgF+raaG5JsBsI+gG6BoJYUP70ydy6E0ZIVrYetZXr2lXQ=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:20:29.363917 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:20:29.380144 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-4a52bd6c-77e3-446f-85f0-9b3714be1396 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Getting quotas for project 721dd52b82194e4d91113d4d688900ae. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:20:29.387164 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-4a52bd6c-77e3-446f-85f0-9b3714be1396 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Getting quotas for user dea6fd8e6a374cd5b12ec7d99f285203 and project 721dd52b82194e4d91113d4d688900ae. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:20:29.418832 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4a52bd6c-77e3-446f-85f0-9b3714be1396 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.438016 Oct 01 04:20:29.420407 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 146/298] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 1 04:20:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:20:29.426556 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2e1fa828-72b8-4bd6-8447-e41a4824c1eb tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-955169214", "imageRef": "739d9f90-3f46-43ac-8648-4364541564fb", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-593196368", "networks": [{"uuid": "92f08451-a23c-40f8-9010-ae62f55617be"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:20:29.707503 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-b52a1c34-b016-4e79-97d1-89abe029d5ce tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 04:20:29.708039 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-b52a1c34-b016-4e79-97d1-89abe029d5ce tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 04:20:29.708625 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-b52a1c34-b016-4e79-97d1-89abe029d5ce tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 04:20:29.709165 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-b52a1c34-b016-4e79-97d1-89abe029d5ce tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 04:20:29.709684 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-b52a1c34-b016-4e79-97d1-89abe029d5ce tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 04:20:29.721514 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b52a1c34-b016-4e79-97d1-89abe029d5ce tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:29.722307 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b52a1c34-b016-4e79-97d1-89abe029d5ce tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:29.723031 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b52a1c34-b016-4e79-97d1-89abe029d5ce tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:29.723974 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b52a1c34-b016-4e79-97d1-89abe029d5ce tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:29.724899 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b52a1c34-b016-4e79-97d1-89abe029d5ce tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:29.725560 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b52a1c34-b016-4e79-97d1-89abe029d5ce tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:29.753195 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-b52a1c34-b016-4e79-97d1-89abe029d5ce tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Getting quotas for project 839c91c5262a49768c3e937b5a034137. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:20:29.762896 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-b52a1c34-b016-4e79-97d1-89abe029d5ce tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Getting quotas for user 7014a1defd81461787318bc27d56b9aa and project 839c91c5262a49768c3e937b5a034137. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:20:29.781508 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b52a1c34-b016-4e79-97d1-89abe029d5ce tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 04:20:29.784156 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b52a1c34-b016-4e79-97d1-89abe029d5ce tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c63d52d7-4e3d-40cf-a8b5-59a2d027d793',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 04:20:29.866054 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b52a1c34-b016-4e79-97d1-89abe029d5ce tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 6.795876 Oct 01 04:20:29.867170 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 153/299] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 1 04:20:23 2022] POST /compute/v2.1/servers => generated 408 bytes in 6798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 04:20:29.875064 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-222bd659-5adf-4beb-8416-049d563e0d19 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:29.876043 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-222bd659-5adf-4beb-8416-049d563e0d19 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:29.887271 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-222bd659-5adf-4beb-8416-049d563e0d19 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:29.888024 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-222bd659-5adf-4beb-8416-049d563e0d19 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:29.888688 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-222bd659-5adf-4beb-8416-049d563e0d19 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:29.889656 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-222bd659-5adf-4beb-8416-049d563e0d19 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:29.890327 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-222bd659-5adf-4beb-8416-049d563e0d19 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:29.890973 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-222bd659-5adf-4beb-8416-049d563e0d19 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:30.118324 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-222bd659-5adf-4beb-8416-049d563e0d19 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:30.154415 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-222bd659-5adf-4beb-8416-049d563e0d19 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:30.156575 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-222bd659-5adf-4beb-8416-049d563e0d19 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:30.158930 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-222bd659-5adf-4beb-8416-049d563e0d19 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1740 microversion: 2.20 time: 0.289830 Oct 01 04:20:30.160177 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 154/300] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:29 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1740 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:20:30.167570 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b0ceebe2-46a6-42ce-b101-52e004bca236 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:30.168447 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b0ceebe2-46a6-42ce-b101-52e004bca236 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 43214db8-967a-4a0d-938b-85b40b1730da] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:30.202194 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0ceebe2-46a6-42ce-b101-52e004bca236 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:30.202697 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0ceebe2-46a6-42ce-b101-52e004bca236 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:30.203138 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0ceebe2-46a6-42ce-b101-52e004bca236 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:30.203857 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0ceebe2-46a6-42ce-b101-52e004bca236 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:30.204321 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0ceebe2-46a6-42ce-b101-52e004bca236 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:30.204749 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0ceebe2-46a6-42ce-b101-52e004bca236 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:30.606003 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b0ceebe2-46a6-42ce-b101-52e004bca236 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27dc4e15e61e44c8905e713a190a45d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6452abdab41846a5915b7ea5d81b9811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:30.615951 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b0ceebe2-46a6-42ce-b101-52e004bca236 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da" status: 200 len: 1313 microversion: 2.1 time: 0.454370 Oct 01 04:20:30.616540 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 155/301] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:30 2022] GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da => generated 1313 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:30.623089 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e5a0fbce-ccef-4bc6-a561-fa1743d9a0dd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:30.623939 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e5a0fbce-ccef-4bc6-a561-fa1743d9a0dd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:30.630557 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5a0fbce-ccef-4bc6-a561-fa1743d9a0dd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:30.631323 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5a0fbce-ccef-4bc6-a561-fa1743d9a0dd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:30.632580 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5a0fbce-ccef-4bc6-a561-fa1743d9a0dd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:30.633542 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5a0fbce-ccef-4bc6-a561-fa1743d9a0dd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:30.634161 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5a0fbce-ccef-4bc6-a561-fa1743d9a0dd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:30.635326 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e5a0fbce-ccef-4bc6-a561-fa1743d9a0dd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:30.742840 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e5a0fbce-ccef-4bc6-a561-fa1743d9a0dd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:30.760388 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e5a0fbce-ccef-4bc6-a561-fa1743d9a0dd tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1249 microversion: 2.1 time: 0.140053 Oct 01 04:20:30.762473 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 156/302] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:30 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1249 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:31.190670 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3379c248-f257-483a-9c26-1c23f6469870 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:31.191273 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3379c248-f257-483a-9c26-1c23f6469870 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:31.200028 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3379c248-f257-483a-9c26-1c23f6469870 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:31.200607 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3379c248-f257-483a-9c26-1c23f6469870 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:31.202038 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3379c248-f257-483a-9c26-1c23f6469870 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:31.203619 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3379c248-f257-483a-9c26-1c23f6469870 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:31.204849 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3379c248-f257-483a-9c26-1c23f6469870 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:31.205508 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3379c248-f257-483a-9c26-1c23f6469870 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:31.488844 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-3379c248-f257-483a-9c26-1c23f6469870 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:31.514724 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-3379c248-f257-483a-9c26-1c23f6469870 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:31.524948 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-3379c248-f257-483a-9c26-1c23f6469870 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:31.526552 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3379c248-f257-483a-9c26-1c23f6469870 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1740 microversion: 2.20 time: 0.339767 Oct 01 04:20:31.527621 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 157/303] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:31 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1740 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:20:31.645369 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-11fa292b-8ecf-4f0a-9d71-aec87cdc095f tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:31.646283 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-11fa292b-8ecf-4f0a-9d71-aec87cdc095f tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 43214db8-967a-4a0d-938b-85b40b1730da] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:31.655395 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11fa292b-8ecf-4f0a-9d71-aec87cdc095f tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:31.655872 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11fa292b-8ecf-4f0a-9d71-aec87cdc095f tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:31.656313 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11fa292b-8ecf-4f0a-9d71-aec87cdc095f tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:31.662276 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11fa292b-8ecf-4f0a-9d71-aec87cdc095f tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:31.662965 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11fa292b-8ecf-4f0a-9d71-aec87cdc095f tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:31.663729 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11fa292b-8ecf-4f0a-9d71-aec87cdc095f tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:31.918458 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-11fa292b-8ecf-4f0a-9d71-aec87cdc095f tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27dc4e15e61e44c8905e713a190a45d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6452abdab41846a5915b7ea5d81b9811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:31.927332 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-11fa292b-8ecf-4f0a-9d71-aec87cdc095f tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da" status: 200 len: 1498 microversion: 2.1 time: 0.286598 Oct 01 04:20:31.940959 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 158/304] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:31 2022] GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da => generated 1498 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:31.941313 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-de2eccc3-bb14-40d2-9481-8f4e020a762e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:31.941876 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-de2eccc3-bb14-40d2-9481-8f4e020a762e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:31.974178 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de2eccc3-bb14-40d2-9481-8f4e020a762e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:31.975244 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de2eccc3-bb14-40d2-9481-8f4e020a762e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:31.977662 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de2eccc3-bb14-40d2-9481-8f4e020a762e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:31.979396 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de2eccc3-bb14-40d2-9481-8f4e020a762e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:31.990070 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de2eccc3-bb14-40d2-9481-8f4e020a762e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:31.996129 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de2eccc3-bb14-40d2-9481-8f4e020a762e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:32.198318 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-de2eccc3-bb14-40d2-9481-8f4e020a762e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:32.212193 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-de2eccc3-bb14-40d2-9481-8f4e020a762e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1305 microversion: 2.1 time: 0.282951 Oct 01 04:20:32.214495 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 159/305] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:31 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1305 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:32.558099 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0fd9ff72-5cf7-490e-b831-4fb5a7f06eec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:32.558708 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0fd9ff72-5cf7-490e-b831-4fb5a7f06eec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:32.573360 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fd9ff72-5cf7-490e-b831-4fb5a7f06eec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:32.574076 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fd9ff72-5cf7-490e-b831-4fb5a7f06eec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:32.576679 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fd9ff72-5cf7-490e-b831-4fb5a7f06eec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:32.578353 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fd9ff72-5cf7-490e-b831-4fb5a7f06eec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:32.581205 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fd9ff72-5cf7-490e-b831-4fb5a7f06eec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:32.581814 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0fd9ff72-5cf7-490e-b831-4fb5a7f06eec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:32.893122 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0fd9ff72-5cf7-490e-b831-4fb5a7f06eec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:32.918949 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0fd9ff72-5cf7-490e-b831-4fb5a7f06eec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:32.924813 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0fd9ff72-5cf7-490e-b831-4fb5a7f06eec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:32.930405 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0fd9ff72-5cf7-490e-b831-4fb5a7f06eec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1740 microversion: 2.20 time: 0.378479 Oct 01 04:20:32.931431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 160/306] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:32 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1740 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:20:32.954302 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-794004ca-71ae-4240-b7f0-795096be923b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:32.955513 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-794004ca-71ae-4240-b7f0-795096be923b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 43214db8-967a-4a0d-938b-85b40b1730da] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:32.966045 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-794004ca-71ae-4240-b7f0-795096be923b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:32.966968 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-794004ca-71ae-4240-b7f0-795096be923b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:32.967505 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-794004ca-71ae-4240-b7f0-795096be923b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:32.968667 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-794004ca-71ae-4240-b7f0-795096be923b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:32.969380 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-794004ca-71ae-4240-b7f0-795096be923b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:32.970097 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-794004ca-71ae-4240-b7f0-795096be923b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:33.006588 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-794004ca-71ae-4240-b7f0-795096be923b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 43214db8-967a-4a0d-938b-85b40b1730da] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 04:20:33.180237 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-794004ca-71ae-4240-b7f0-795096be923b tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "DELETE /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da" status: 204 len: 0 microversion: 2.1 time: 0.247214 Oct 01 04:20:33.182014 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 161/307] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 1 04:20:32 2022] DELETE /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 04:20:33.190974 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-17d3c126-2b17-450f-b87e-2d354800f836 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:33.191682 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-17d3c126-2b17-450f-b87e-2d354800f836 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 43214db8-967a-4a0d-938b-85b40b1730da] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:33.223643 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17d3c126-2b17-450f-b87e-2d354800f836 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:33.224867 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17d3c126-2b17-450f-b87e-2d354800f836 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:33.225514 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17d3c126-2b17-450f-b87e-2d354800f836 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:33.226382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17d3c126-2b17-450f-b87e-2d354800f836 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:33.226987 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17d3c126-2b17-450f-b87e-2d354800f836 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:33.227571 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17d3c126-2b17-450f-b87e-2d354800f836 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:33.441175 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-17d3c126-2b17-450f-b87e-2d354800f836 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27dc4e15e61e44c8905e713a190a45d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6452abdab41846a5915b7ea5d81b9811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:33.451146 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-17d3c126-2b17-450f-b87e-2d354800f836 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da" status: 200 len: 1504 microversion: 2.1 time: 0.264327 Oct 01 04:20:33.454045 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 162/308] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:33 2022] GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da => generated 1504 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:33.469020 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-88e1306f-8a99-40d8-8e51-6f084abaab46 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:33.469634 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-88e1306f-8a99-40d8-8e51-6f084abaab46 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:33.485329 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88e1306f-8a99-40d8-8e51-6f084abaab46 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:33.485822 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88e1306f-8a99-40d8-8e51-6f084abaab46 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:33.486251 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88e1306f-8a99-40d8-8e51-6f084abaab46 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:33.486953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88e1306f-8a99-40d8-8e51-6f084abaab46 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:33.487407 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88e1306f-8a99-40d8-8e51-6f084abaab46 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:33.487826 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88e1306f-8a99-40d8-8e51-6f084abaab46 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:33.741381 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-88e1306f-8a99-40d8-8e51-6f084abaab46 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:33.751693 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-88e1306f-8a99-40d8-8e51-6f084abaab46 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1370 microversion: 2.1 time: 0.298176 Oct 01 04:20:33.752992 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 163/309] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:33 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1370 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:33.960232 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aaf0e55e-4a4d-4d3d-84c9-1729901a4aa1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:33.960816 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aaf0e55e-4a4d-4d3d-84c9-1729901a4aa1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:33.974266 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaf0e55e-4a4d-4d3d-84c9-1729901a4aa1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:33.975234 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaf0e55e-4a4d-4d3d-84c9-1729901a4aa1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:33.975733 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaf0e55e-4a4d-4d3d-84c9-1729901a4aa1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:33.976503 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaf0e55e-4a4d-4d3d-84c9-1729901a4aa1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:33.977010 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaf0e55e-4a4d-4d3d-84c9-1729901a4aa1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:33.977437 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaf0e55e-4a4d-4d3d-84c9-1729901a4aa1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:34.144948 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-aaf0e55e-4a4d-4d3d-84c9-1729901a4aa1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:34.153978 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-aaf0e55e-4a4d-4d3d-84c9-1729901a4aa1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:34.155440 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-aaf0e55e-4a4d-4d3d-84c9-1729901a4aa1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:34.156604 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aaf0e55e-4a4d-4d3d-84c9-1729901a4aa1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1740 microversion: 2.20 time: 0.200315 Oct 01 04:20:34.246763 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 164/310] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:33 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1740 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:20:34.475633 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b860b824-d2e6-4f75-a4e0-d9971582f02a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:34.476239 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b860b824-d2e6-4f75-a4e0-d9971582f02a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 43214db8-967a-4a0d-938b-85b40b1730da] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:34.491133 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b860b824-d2e6-4f75-a4e0-d9971582f02a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:34.491133 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b860b824-d2e6-4f75-a4e0-d9971582f02a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:34.491133 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b860b824-d2e6-4f75-a4e0-d9971582f02a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:34.491760 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b860b824-d2e6-4f75-a4e0-d9971582f02a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:34.492265 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b860b824-d2e6-4f75-a4e0-d9971582f02a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:34.493059 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b860b824-d2e6-4f75-a4e0-d9971582f02a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:34.761554 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b860b824-d2e6-4f75-a4e0-d9971582f02a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27dc4e15e61e44c8905e713a190a45d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6452abdab41846a5915b7ea5d81b9811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:34.779312 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b860b824-d2e6-4f75-a4e0-d9971582f02a tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da" status: 200 len: 1504 microversion: 2.1 time: 0.307374 Oct 01 04:20:34.785292 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 165/311] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:34 2022] GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da => generated 1504 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:20:34.792638 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-97bc1c3a-660d-435f-8fb6-012de8324507 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:34.792638 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-97bc1c3a-660d-435f-8fb6-012de8324507 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:34.806251 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97bc1c3a-660d-435f-8fb6-012de8324507 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:34.806742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97bc1c3a-660d-435f-8fb6-012de8324507 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:34.807800 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97bc1c3a-660d-435f-8fb6-012de8324507 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:34.809106 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97bc1c3a-660d-435f-8fb6-012de8324507 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:34.809841 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97bc1c3a-660d-435f-8fb6-012de8324507 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:34.810433 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97bc1c3a-660d-435f-8fb6-012de8324507 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:35.012774 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-97bc1c3a-660d-435f-8fb6-012de8324507 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:35.023032 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-97bc1c3a-660d-435f-8fb6-012de8324507 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1370 microversion: 2.1 time: 0.236200 Oct 01 04:20:35.024335 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 166/312] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:34 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1370 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:35.195599 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fb991f0d-c9a6-4e29-a1d5-3fd828f0bfa8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:35.196103 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fb991f0d-c9a6-4e29-a1d5-3fd828f0bfa8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:35.208659 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb991f0d-c9a6-4e29-a1d5-3fd828f0bfa8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:35.209275 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb991f0d-c9a6-4e29-a1d5-3fd828f0bfa8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:35.209717 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb991f0d-c9a6-4e29-a1d5-3fd828f0bfa8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:35.210696 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb991f0d-c9a6-4e29-a1d5-3fd828f0bfa8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:35.210946 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb991f0d-c9a6-4e29-a1d5-3fd828f0bfa8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:35.211384 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fb991f0d-c9a6-4e29-a1d5-3fd828f0bfa8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:35.237325 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:20:35.387002 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-fb991f0d-c9a6-4e29-a1d5-3fd828f0bfa8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:35.395679 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-fb991f0d-c9a6-4e29-a1d5-3fd828f0bfa8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:35.397381 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-fb991f0d-c9a6-4e29-a1d5-3fd828f0bfa8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:35.398739 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fb991f0d-c9a6-4e29-a1d5-3fd828f0bfa8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1740 microversion: 2.20 time: 0.208645 Oct 01 04:20:35.400094 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 167/313] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:35 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:20:35.787070 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-f7e6c761-8d64-4b64-8ea5-b7af81b30880 req-ae31f9ce-8510-44b4-af32-8ccb1ee11f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43214db8-967a-4a0d-938b-85b40b1730da", "name": "network-vif-deleted", "tag": "7136ea86-24d8-4389-94ab-9649799d8818"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:20:35.806709 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f7e6c761-8d64-4b64-8ea5-b7af81b30880 req-ae31f9ce-8510-44b4-af32-8ccb1ee11f70 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:35.807695 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f7e6c761-8d64-4b64-8ea5-b7af81b30880 req-ae31f9ce-8510-44b4-af32-8ccb1ee11f70 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:35.808350 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f7e6c761-8d64-4b64-8ea5-b7af81b30880 req-ae31f9ce-8510-44b4-af32-8ccb1ee11f70 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:35.822563 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-f7e6c761-8d64-4b64-8ea5-b7af81b30880 req-ae31f9ce-8510-44b4-af32-8ccb1ee11f70 service nova] Creating event network-vif-deleted:7136ea86-24d8-4389-94ab-9649799d8818 for instance 43214db8-967a-4a0d-938b-85b40b1730da on hv-cinder-86004 Oct 01 04:20:35.828388 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-f7e6c761-8d64-4b64-8ea5-b7af81b30880 req-ae31f9ce-8510-44b4-af32-8ccb1ee11f70 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045394 Oct 01 04:20:35.829297 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 168/314] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:20:35.835974 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1067d1ce-2a1a-4c13-a45e-7f08cc59a2a4 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:35.838474 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1067d1ce-2a1a-4c13-a45e-7f08cc59a2a4 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 43214db8-967a-4a0d-938b-85b40b1730da] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:35.847073 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1067d1ce-2a1a-4c13-a45e-7f08cc59a2a4 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:35.847958 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1067d1ce-2a1a-4c13-a45e-7f08cc59a2a4 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:35.848649 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1067d1ce-2a1a-4c13-a45e-7f08cc59a2a4 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:35.849933 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1067d1ce-2a1a-4c13-a45e-7f08cc59a2a4 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:35.850791 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1067d1ce-2a1a-4c13-a45e-7f08cc59a2a4 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:35.852014 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1067d1ce-2a1a-4c13-a45e-7f08cc59a2a4 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:35.933191 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-2e1fa828-72b8-4bd6-8447-e41a4824c1eb tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] validate_networks() for [('92f08451-a23c-40f8-9010-ae62f55617be', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 04:20:36.122250 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1067d1ce-2a1a-4c13-a45e-7f08cc59a2a4 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27dc4e15e61e44c8905e713a190a45d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6452abdab41846a5915b7ea5d81b9811', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:36.136060 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1067d1ce-2a1a-4c13-a45e-7f08cc59a2a4 tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da" status: 200 len: 1298 microversion: 2.1 time: 0.305133 Oct 01 04:20:36.159973 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 169/315] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:35 2022] GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da => generated 1298 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:36.166422 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8b087816-efba-4e2f-bab8-a6f6b526c306 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:36.167659 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8b087816-efba-4e2f-bab8-a6f6b526c306 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:36.179042 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b087816-efba-4e2f-bab8-a6f6b526c306 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:36.182340 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b087816-efba-4e2f-bab8-a6f6b526c306 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:36.182860 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b087816-efba-4e2f-bab8-a6f6b526c306 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:36.183681 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b087816-efba-4e2f-bab8-a6f6b526c306 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:36.184228 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b087816-efba-4e2f-bab8-a6f6b526c306 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:36.184723 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b087816-efba-4e2f-bab8-a6f6b526c306 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:36.425475 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8b087816-efba-4e2f-bab8-a6f6b526c306 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:36.435847 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8b087816-efba-4e2f-bab8-a6f6b526c306 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1370 microversion: 2.1 time: 0.274700 Oct 01 04:20:36.436431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 170/316] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:36 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1370 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:36.446029 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-40dc81c1-6502-4ba2-8a66-80a398f29a99 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:36.447272 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-40dc81c1-6502-4ba2-8a66-80a398f29a99 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:36.453713 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-40dc81c1-6502-4ba2-8a66-80a398f29a99 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:36.454313 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-40dc81c1-6502-4ba2-8a66-80a398f29a99 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:36.455063 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-40dc81c1-6502-4ba2-8a66-80a398f29a99 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:36.456116 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-40dc81c1-6502-4ba2-8a66-80a398f29a99 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:36.456654 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-40dc81c1-6502-4ba2-8a66-80a398f29a99 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:36.457185 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-40dc81c1-6502-4ba2-8a66-80a398f29a99 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:36.777249 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-40dc81c1-6502-4ba2-8a66-80a398f29a99 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:36.787192 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-40dc81c1-6502-4ba2-8a66-80a398f29a99 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:36.788971 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-40dc81c1-6502-4ba2-8a66-80a398f29a99 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:36.790389 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-40dc81c1-6502-4ba2-8a66-80a398f29a99 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1740 microversion: 2.20 time: 0.352705 Oct 01 04:20:36.791305 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 171/317] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:36 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1740 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:20:36.804987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-2e1fa828-72b8-4bd6-8447-e41a4824c1eb tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 04:20:36.805594 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-2e1fa828-72b8-4bd6-8447-e41a4824c1eb tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 04:20:36.806808 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-2e1fa828-72b8-4bd6-8447-e41a4824c1eb tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 04:20:36.807392 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-2e1fa828-72b8-4bd6-8447-e41a4824c1eb tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 04:20:36.808090 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-2e1fa828-72b8-4bd6-8447-e41a4824c1eb tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 04:20:36.817879 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e1fa828-72b8-4bd6-8447-e41a4824c1eb tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:36.818383 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e1fa828-72b8-4bd6-8447-e41a4824c1eb tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:36.818784 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e1fa828-72b8-4bd6-8447-e41a4824c1eb tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:36.819500 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e1fa828-72b8-4bd6-8447-e41a4824c1eb tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:36.819953 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e1fa828-72b8-4bd6-8447-e41a4824c1eb tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:36.820375 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2e1fa828-72b8-4bd6-8447-e41a4824c1eb tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:36.828509 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:20:36.842778 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-2e1fa828-72b8-4bd6-8447-e41a4824c1eb tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Getting quotas for project 1d29e2e750f948e1b0ccd4117c0d347a. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:20:36.846732 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-2e1fa828-72b8-4bd6-8447-e41a4824c1eb tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Getting quotas for user 3d75f6b795064e00b20207e6cfc22cf1 and project 1d29e2e750f948e1b0ccd4117c0d347a. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:20:36.858206 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2e1fa828-72b8-4bd6-8447-e41a4824c1eb tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 04:20:36.860546 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2e1fa828-72b8-4bd6-8447-e41a4824c1eb tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='739d9f90-3f46-43ac-8648-4364541564fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 04:20:36.910688 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2e1fa828-72b8-4bd6-8447-e41a4824c1eb tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.488633 Oct 01 04:20:36.911377 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 147/318] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 1 04:20:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 7490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 04:20:36.923522 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8c946025-06e6-4aca-8276-97a28120dde6 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:36.924471 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8c946025-06e6-4aca-8276-97a28120dde6 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:37.028022 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8c946025-06e6-4aca-8276-97a28120dde6 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:37.039785 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8c946025-06e6-4aca-8276-97a28120dde6 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1257 microversion: 2.1 time: 0.119550 Oct 01 04:20:37.048235 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 172/319] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:36 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1257 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:37.164053 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6f29655a-2e63-4033-844e-f1dde9accfed tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:37.166143 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6f29655a-2e63-4033-844e-f1dde9accfed tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] [instance: 43214db8-967a-4a0d-938b-85b40b1730da] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:37.173695 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f29655a-2e63-4033-844e-f1dde9accfed tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:37.174186 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f29655a-2e63-4033-844e-f1dde9accfed tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:37.174631 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f29655a-2e63-4033-844e-f1dde9accfed tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:37.175337 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f29655a-2e63-4033-844e-f1dde9accfed tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:37.175790 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f29655a-2e63-4033-844e-f1dde9accfed tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:37.176212 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6f29655a-2e63-4033-844e-f1dde9accfed tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:37.191139 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-6f29655a-2e63-4033-844e-f1dde9accfed tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] HTTP exception thrown: Instance 43214db8-967a-4a0d-938b-85b40b1730da could not be found. Oct 01 04:20:37.192880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6f29655a-2e63-4033-844e-f1dde9accfed tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Request method failure captured: Oct 01 04:20:37.192880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da HTTP/1.1 Oct 01 04:20:37.192880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept: application/json Oct 01 04:20:37.192880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept-Encoding: identity Oct 01 04:20:37.192880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Connection: close Oct 01 04:20:37.192880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Length: 0 Oct 01 04:20:37.192880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Type: application/json Oct 01 04:20:37.192880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Host: 10.222.0.26 Oct 01 04:20:37.192880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 01 04:20:37.192880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 01 04:20:37.192880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjN7_fPb68k_YYXNwYrRXi9idGSg4PWvCp8eD48khxD-v_HDxJhBGf2fnYt8sljaLN1aAuEpq2qjgWYEbaEpq6xvvOebPr60tzlisu2KyeII73SkKbWF1dicqK-5Wfj18HhbQPVNRk4UZcPzzmO3Sd64RfooL7AZDf1KGDVomPVMa5UF8 Oct 01 04:20:37.192880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Id: None Oct 01 04:20:37.192880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Name: None Oct 01 04:20:37.192880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 01 04:20:37.192880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 01 04:20:37.192880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 01 04:20:37.192880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 01 04:20:37.192880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Id: 6452abdab41846a5915b7ea5d81b9811 Oct 01 04:20:37.192880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Name: tempest-VolumesActionsTest-1528452928 Oct 01 04:20:37.192880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Role: reader,member Oct 01 04:20:37.192880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Roles: reader,member Oct 01 04:20:37.194281 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6452abdab41846a5915b7ea5d81b9811"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6452abdab41846a5915b7ea5d81b9811"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6452abdab41846a5915b7ea5d81b9811"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6452abdab41846a5915b7ea5d81b9811"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:20:37.194281 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant: tempest-VolumesActionsTest-1528452928 Oct 01 04:20:37.194281 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Id: 6452abdab41846a5915b7ea5d81b9811 Oct 01 04:20:37.194281 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Name: tempest-VolumesActionsTest-1528452928 Oct 01 04:20:37.194281 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User: tempest-VolumesActionsTest-1528452928-project Oct 01 04:20:37.194281 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 01 04:20:37.194281 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 01 04:20:37.194281 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Id: 27dc4e15e61e44c8905e713a190a45d3 Oct 01 04:20:37.194281 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Name: tempest-VolumesActionsTest-1528452928-project Oct 01 04:20:37.194281 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: method: > Oct 01 04:20:37.194281 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: exception: Instance 43214db8-967a-4a0d-938b-85b40b1730da could not be found. Oct 01 04:20:37.194281 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: action_args: {'id': '43214db8-967a-4a0d-938b-85b40b1730da'} Oct 01 04:20:37.195042 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:20:37.195042 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:20:37.195042 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:20:37.195042 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:20:37.195042 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:20:37.195042 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:20:37.195042 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:20:37.195042 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:20:37.195042 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:20:37.195042 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:20:37.195042 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43214db8-967a-4a0d-938b-85b40b1730da could not be found. Oct 01 04:20:37.195042 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:20:37.195042 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:20:37.195042 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:20:37.195042 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:20:37.195042 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:20:37.195042 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:20:37.195042 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:20:37.195042 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:20:37.195042 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:20:37.196300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:20:37.196300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:20:37.196300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:20:37.196300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:20:37.196300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:20:37.196300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:20:37.196300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:20:37.196300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43214db8-967a-4a0d-938b-85b40b1730da could not be found. Oct 01 04:20:37.196300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:20:37.196300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:20:37.196300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:20:37.196300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:20:37.196300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:20:37.196300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:20:37.196300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:20:37.196300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:20:37.196300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43214db8-967a-4a0d-938b-85b40b1730da could not be found. Oct 01 04:20:37.196300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:20:37.200133 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6f29655a-2e63-4033-844e-f1dde9accfed tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] Returning 404 to user: Instance 43214db8-967a-4a0d-938b-85b40b1730da could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:20:37.200133 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6f29655a-2e63-4033-844e-f1dde9accfed tempest-VolumesActionsTest-1528452928 tempest-VolumesActionsTest-1528452928-project] 10.222.0.26 "GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da" status: 404 len: 111 microversion: 2.1 time: 0.038282 Oct 01 04:20:37.200133 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 148/320] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:37 2022] GET /compute/v2.1/servers/43214db8-967a-4a0d-938b-85b40b1730da => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:20:37.461632 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-137f58e8-e556-4aa1-8c87-3dcd2790f146 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:37.462191 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-137f58e8-e556-4aa1-8c87-3dcd2790f146 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:37.496794 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-137f58e8-e556-4aa1-8c87-3dcd2790f146 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:37.510121 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-137f58e8-e556-4aa1-8c87-3dcd2790f146 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:37.510735 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-137f58e8-e556-4aa1-8c87-3dcd2790f146 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:37.511496 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-137f58e8-e556-4aa1-8c87-3dcd2790f146 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:37.511966 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-137f58e8-e556-4aa1-8c87-3dcd2790f146 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:37.512453 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-137f58e8-e556-4aa1-8c87-3dcd2790f146 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:37.668127 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-137f58e8-e556-4aa1-8c87-3dcd2790f146 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:37.676032 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-137f58e8-e556-4aa1-8c87-3dcd2790f146 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1370 microversion: 2.1 time: 0.218396 Oct 01 04:20:37.676594 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 173/321] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:37 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1370 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:37.825970 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c41d51ac-97e7-4a14-b365-1bb35d22f655 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:37.826781 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c41d51ac-97e7-4a14-b365-1bb35d22f655 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:37.833632 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c41d51ac-97e7-4a14-b365-1bb35d22f655 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:37.834282 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c41d51ac-97e7-4a14-b365-1bb35d22f655 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:37.834537 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c41d51ac-97e7-4a14-b365-1bb35d22f655 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:37.835921 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c41d51ac-97e7-4a14-b365-1bb35d22f655 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:37.836457 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c41d51ac-97e7-4a14-b365-1bb35d22f655 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:37.836882 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c41d51ac-97e7-4a14-b365-1bb35d22f655 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:37.847626 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-286d3ef4-e2b3-459e-bb6e-d08363532ff6 req-702853e5-f52c-44fc-8feb-2f0444431383 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6436bdc-2e17-43d4-a123-900e6269e551", "tag": "2a43b463-65b3-423d-b16f-bcbd2964f478"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:20:37.860605 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-286d3ef4-e2b3-459e-bb6e-d08363532ff6 req-702853e5-f52c-44fc-8feb-2f0444431383 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:37.861218 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-286d3ef4-e2b3-459e-bb6e-d08363532ff6 req-702853e5-f52c-44fc-8feb-2f0444431383 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:37.861722 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-286d3ef4-e2b3-459e-bb6e-d08363532ff6 req-702853e5-f52c-44fc-8feb-2f0444431383 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:37.875769 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-286d3ef4-e2b3-459e-bb6e-d08363532ff6 req-702853e5-f52c-44fc-8feb-2f0444431383 service nova] Creating event network-changed:2a43b463-65b3-423d-b16f-bcbd2964f478 for instance c6436bdc-2e17-43d4-a123-900e6269e551 on hv-cinder-86004 Oct 01 04:20:37.879868 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-286d3ef4-e2b3-459e-bb6e-d08363532ff6 req-702853e5-f52c-44fc-8feb-2f0444431383 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038686 Oct 01 04:20:37.880563 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 174/322] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:20:37.982522 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c41d51ac-97e7-4a14-b365-1bb35d22f655 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:37.990728 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c41d51ac-97e7-4a14-b365-1bb35d22f655 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:37.992180 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c41d51ac-97e7-4a14-b365-1bb35d22f655 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:37.993413 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c41d51ac-97e7-4a14-b365-1bb35d22f655 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1722 microversion: 2.20 time: 0.171769 Oct 01 04:20:37.994315 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 149/323] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:37 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:20:38.062985 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7299f469-3f33-49d7-a88a-f2896a037178 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:38.063678 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7299f469-3f33-49d7-a88a-f2896a037178 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:38.069920 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7299f469-3f33-49d7-a88a-f2896a037178 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:38.070396 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7299f469-3f33-49d7-a88a-f2896a037178 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:38.070822 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7299f469-3f33-49d7-a88a-f2896a037178 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:38.072053 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7299f469-3f33-49d7-a88a-f2896a037178 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:38.072522 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7299f469-3f33-49d7-a88a-f2896a037178 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:38.072945 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7299f469-3f33-49d7-a88a-f2896a037178 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:38.139174 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7299f469-3f33-49d7-a88a-f2896a037178 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:38.147886 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7299f469-3f33-49d7-a88a-f2896a037178 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1261 microversion: 2.1 time: 0.089166 Oct 01 04:20:38.148894 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 175/324] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:38 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1261 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:38.700392 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7efa90e5-4b1d-400b-8423-ec7270ca9aa0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:38.701042 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7efa90e5-4b1d-400b-8423-ec7270ca9aa0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:38.707483 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7efa90e5-4b1d-400b-8423-ec7270ca9aa0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:38.708031 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7efa90e5-4b1d-400b-8423-ec7270ca9aa0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:38.708466 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7efa90e5-4b1d-400b-8423-ec7270ca9aa0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:38.709205 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7efa90e5-4b1d-400b-8423-ec7270ca9aa0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:38.709664 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7efa90e5-4b1d-400b-8423-ec7270ca9aa0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:38.710087 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7efa90e5-4b1d-400b-8423-ec7270ca9aa0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:38.841233 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-7efa90e5-4b1d-400b-8423-ec7270ca9aa0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:38.850517 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7efa90e5-4b1d-400b-8423-ec7270ca9aa0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1370 microversion: 2.1 time: 0.155136 Oct 01 04:20:38.851106 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 150/325] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:38 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:39.020741 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cff11755-9fb5-4804-a940-d72b0c720c62 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:39.021374 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cff11755-9fb5-4804-a940-d72b0c720c62 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:39.028518 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cff11755-9fb5-4804-a940-d72b0c720c62 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:39.029034 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cff11755-9fb5-4804-a940-d72b0c720c62 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:39.029468 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cff11755-9fb5-4804-a940-d72b0c720c62 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:39.030163 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cff11755-9fb5-4804-a940-d72b0c720c62 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:39.030619 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cff11755-9fb5-4804-a940-d72b0c720c62 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:39.031039 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cff11755-9fb5-4804-a940-d72b0c720c62 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:39.170807 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-cff11755-9fb5-4804-a940-d72b0c720c62 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:39.171663 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c1ce7cbd-5e2d-4dec-a9f1-9645d92018f9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:39.172272 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c1ce7cbd-5e2d-4dec-a9f1-9645d92018f9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:39.178089 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1ce7cbd-5e2d-4dec-a9f1-9645d92018f9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:39.178558 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1ce7cbd-5e2d-4dec-a9f1-9645d92018f9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:39.178861 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-cff11755-9fb5-4804-a940-d72b0c720c62 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:39.178980 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1ce7cbd-5e2d-4dec-a9f1-9645d92018f9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:39.179659 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1ce7cbd-5e2d-4dec-a9f1-9645d92018f9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:39.180112 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1ce7cbd-5e2d-4dec-a9f1-9645d92018f9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:39.180306 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-cff11755-9fb5-4804-a940-d72b0c720c62 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:39.180531 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c1ce7cbd-5e2d-4dec-a9f1-9645d92018f9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:39.182019 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cff11755-9fb5-4804-a940-d72b0c720c62 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1722 microversion: 2.20 time: 0.165134 Oct 01 04:20:39.182567 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 176/326] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:39 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:20:39.247368 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c1ce7cbd-5e2d-4dec-a9f1-9645d92018f9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:39.254939 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c1ce7cbd-5e2d-4dec-a9f1-9645d92018f9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1309 microversion: 2.1 time: 0.087042 Oct 01 04:20:39.255492 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 151/327] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:39 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1309 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:20:39.689991 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-8421113b-93ac-4c63-9612-4e015484b479 req-be96ccd4-e890-4e61-9e4d-a61cf1688d5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e14e3570-67e7-43d6-bcaf-6688168956b2", "name": "network-vif-unplugged", "status": "completed", "tag": "28ed6420-e14b-48a2-a448-a8ab736b93af"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:20:39.703820 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8421113b-93ac-4c63-9612-4e015484b479 req-be96ccd4-e890-4e61-9e4d-a61cf1688d5d service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:39.704302 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8421113b-93ac-4c63-9612-4e015484b479 req-be96ccd4-e890-4e61-9e4d-a61cf1688d5d service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:39.704744 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8421113b-93ac-4c63-9612-4e015484b479 req-be96ccd4-e890-4e61-9e4d-a61cf1688d5d service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:39.717095 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-8421113b-93ac-4c63-9612-4e015484b479 req-be96ccd4-e890-4e61-9e4d-a61cf1688d5d service nova] Creating event network-vif-unplugged:28ed6420-e14b-48a2-a448-a8ab736b93af for instance e14e3570-67e7-43d6-bcaf-6688168956b2 on hv-cinder-86004 Oct 01 04:20:39.722592 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-8421113b-93ac-4c63-9612-4e015484b479 req-be96ccd4-e890-4e61-9e4d-a61cf1688d5d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036949 Oct 01 04:20:39.723435 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 177/328] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:20:39.874777 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f912125d-6ee2-4fc7-b616-4069ec11ba74 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:39.875426 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f912125d-6ee2-4fc7-b616-4069ec11ba74 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:39.884579 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f912125d-6ee2-4fc7-b616-4069ec11ba74 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:39.885410 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f912125d-6ee2-4fc7-b616-4069ec11ba74 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:39.885880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f912125d-6ee2-4fc7-b616-4069ec11ba74 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:39.886666 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f912125d-6ee2-4fc7-b616-4069ec11ba74 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:39.887147 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f912125d-6ee2-4fc7-b616-4069ec11ba74 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:39.887617 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f912125d-6ee2-4fc7-b616-4069ec11ba74 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:40.034087 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-f912125d-6ee2-4fc7-b616-4069ec11ba74 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:40.043148 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f912125d-6ee2-4fc7-b616-4069ec11ba74 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1370 microversion: 2.1 time: 0.172237 Oct 01 04:20:40.043774 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 152/329] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:39 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:40.210462 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c184d950-51bf-4811-ba50-a578f3ef884e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:40.211809 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c184d950-51bf-4811-ba50-a578f3ef884e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:40.214006 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:20:40.220344 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c184d950-51bf-4811-ba50-a578f3ef884e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:40.221173 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c184d950-51bf-4811-ba50-a578f3ef884e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:40.221825 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c184d950-51bf-4811-ba50-a578f3ef884e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:40.222785 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c184d950-51bf-4811-ba50-a578f3ef884e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:40.223253 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c184d950-51bf-4811-ba50-a578f3ef884e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:40.223681 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c184d950-51bf-4811-ba50-a578f3ef884e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:40.278463 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-01d13382-2325-41ac-97de-b002d0df45aa tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:40.279076 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-01d13382-2325-41ac-97de-b002d0df45aa tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:40.285212 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-01d13382-2325-41ac-97de-b002d0df45aa tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:40.285707 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-01d13382-2325-41ac-97de-b002d0df45aa tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:40.286153 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-01d13382-2325-41ac-97de-b002d0df45aa tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:40.286843 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-01d13382-2325-41ac-97de-b002d0df45aa tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:40.287302 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-01d13382-2325-41ac-97de-b002d0df45aa tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:40.287733 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-01d13382-2325-41ac-97de-b002d0df45aa tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:40.356961 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-01d13382-2325-41ac-97de-b002d0df45aa tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:40.364516 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-01d13382-2325-41ac-97de-b002d0df45aa tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1309 microversion: 2.1 time: 0.090221 Oct 01 04:20:40.365149 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 153/330] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:40 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1309 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:20:40.387384 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c184d950-51bf-4811-ba50-a578f3ef884e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:40.396189 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c184d950-51bf-4811-ba50-a578f3ef884e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:40.397693 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c184d950-51bf-4811-ba50-a578f3ef884e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:40.398832 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c184d950-51bf-4811-ba50-a578f3ef884e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1722 microversion: 2.20 time: 0.192688 Oct 01 04:20:40.400660 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 178/331] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:40 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:20:41.068018 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ff215d47-4491-435d-9fc4-08ae68451c6a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:41.068540 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ff215d47-4491-435d-9fc4-08ae68451c6a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:41.075105 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff215d47-4491-435d-9fc4-08ae68451c6a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:41.075590 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff215d47-4491-435d-9fc4-08ae68451c6a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:41.076023 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff215d47-4491-435d-9fc4-08ae68451c6a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:41.076706 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff215d47-4491-435d-9fc4-08ae68451c6a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:41.077190 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff215d47-4491-435d-9fc4-08ae68451c6a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:41.077628 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ff215d47-4491-435d-9fc4-08ae68451c6a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:41.211623 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-ff215d47-4491-435d-9fc4-08ae68451c6a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:41.220320 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ff215d47-4491-435d-9fc4-08ae68451c6a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1370 microversion: 2.1 time: 0.156195 Oct 01 04:20:41.225028 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 154/332] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:41 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:41.388718 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-93cb4f02-fea2-425b-88f8-2dfed6fd7d5a tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:41.389290 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-93cb4f02-fea2-425b-88f8-2dfed6fd7d5a tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:41.395309 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93cb4f02-fea2-425b-88f8-2dfed6fd7d5a tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:41.395780 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93cb4f02-fea2-425b-88f8-2dfed6fd7d5a tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:41.396219 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93cb4f02-fea2-425b-88f8-2dfed6fd7d5a tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:41.396910 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93cb4f02-fea2-425b-88f8-2dfed6fd7d5a tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:41.397437 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93cb4f02-fea2-425b-88f8-2dfed6fd7d5a tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:41.397867 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-93cb4f02-fea2-425b-88f8-2dfed6fd7d5a tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:41.425821 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8c49dcc7-0441-4110-b8c9-44a0f4609b4c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:41.426424 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8c49dcc7-0441-4110-b8c9-44a0f4609b4c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:41.432405 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c49dcc7-0441-4110-b8c9-44a0f4609b4c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:41.432880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c49dcc7-0441-4110-b8c9-44a0f4609b4c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:41.433340 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c49dcc7-0441-4110-b8c9-44a0f4609b4c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:41.434025 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c49dcc7-0441-4110-b8c9-44a0f4609b4c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:41.434476 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c49dcc7-0441-4110-b8c9-44a0f4609b4c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:41.434895 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c49dcc7-0441-4110-b8c9-44a0f4609b4c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:41.459256 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-93cb4f02-fea2-425b-88f8-2dfed6fd7d5a tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:41.467559 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-93cb4f02-fea2-425b-88f8-2dfed6fd7d5a tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1315 microversion: 2.1 time: 0.082756 Oct 01 04:20:41.468166 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 179/333] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:41 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1315 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:41.565996 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-8c49dcc7-0441-4110-b8c9-44a0f4609b4c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:41.574883 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-8c49dcc7-0441-4110-b8c9-44a0f4609b4c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:41.576326 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-8c49dcc7-0441-4110-b8c9-44a0f4609b4c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:41.577540 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8c49dcc7-0441-4110-b8c9-44a0f4609b4c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1725 microversion: 2.20 time: 0.155579 Oct 01 04:20:41.578092 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 155/334] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:41 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:20:41.603348 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e45cd5a5-b44a-4853-8394-99a3a97011a1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d290f931-1e7e-4464-bb8d-ba6f5bebca18"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:20:41.605836 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e45cd5a5-b44a-4853-8394-99a3a97011a1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:41.611962 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e45cd5a5-b44a-4853-8394-99a3a97011a1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:41.612442 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e45cd5a5-b44a-4853-8394-99a3a97011a1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:41.613061 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e45cd5a5-b44a-4853-8394-99a3a97011a1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:41.613839 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e45cd5a5-b44a-4853-8394-99a3a97011a1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:41.614292 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e45cd5a5-b44a-4853-8394-99a3a97011a1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:41.614709 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e45cd5a5-b44a-4853-8394-99a3a97011a1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:41.902257 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e45cd5a5-b44a-4853-8394-99a3a97011a1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "POST /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.303282 Oct 01 04:20:41.902792 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 180/335] 10.222.0.26 () {62 vars in 1364 bytes} [Sat Oct 1 04:20:41 2022] POST /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2/os-volume_attachments => generated 188 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 04:20:42.027319 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1d94b9a2-b644-468b-b126-8866eb51c2ba tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:20:42.027914 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1d94b9a2-b644-468b-b126-8866eb51c2ba tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:42.033825 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d94b9a2-b644-468b-b126-8866eb51c2ba tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:42.034312 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d94b9a2-b644-468b-b126-8866eb51c2ba tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:42.034748 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d94b9a2-b644-468b-b126-8866eb51c2ba tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:42.035440 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d94b9a2-b644-468b-b126-8866eb51c2ba tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:42.035899 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d94b9a2-b644-468b-b126-8866eb51c2ba tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:42.036323 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d94b9a2-b644-468b-b126-8866eb51c2ba tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:42.080453 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1d94b9a2-b644-468b-b126-8866eb51c2ba tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120597) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 01 04:20:42.146671 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1d94b9a2-b644-468b-b126-8866eb51c2ba tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "POST /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2/action" status: 202 len: 0 microversion: 2.20 time: 0.123490 Oct 01 04:20:42.147272 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 156/336] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 1 04:20:42 2022] POST /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 01 04:20:42.156127 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3edcd5c6-4011-4845-a874-31293543a738 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:42.156694 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3edcd5c6-4011-4845-a874-31293543a738 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:42.163329 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3edcd5c6-4011-4845-a874-31293543a738 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:42.163815 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3edcd5c6-4011-4845-a874-31293543a738 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:42.164250 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3edcd5c6-4011-4845-a874-31293543a738 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:42.164990 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3edcd5c6-4011-4845-a874-31293543a738 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:42.165457 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3edcd5c6-4011-4845-a874-31293543a738 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:42.166095 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3edcd5c6-4011-4845-a874-31293543a738 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:42.245405 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-33407754-a2cd-4faa-89e7-8805b6fb0112 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:42.246168 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-33407754-a2cd-4faa-89e7-8805b6fb0112 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:42.254113 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33407754-a2cd-4faa-89e7-8805b6fb0112 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:42.254877 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33407754-a2cd-4faa-89e7-8805b6fb0112 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:42.255560 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33407754-a2cd-4faa-89e7-8805b6fb0112 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:42.256455 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33407754-a2cd-4faa-89e7-8805b6fb0112 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:42.257140 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33407754-a2cd-4faa-89e7-8805b6fb0112 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:42.257767 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33407754-a2cd-4faa-89e7-8805b6fb0112 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:42.353079 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-3edcd5c6-4011-4845-a874-31293543a738 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:42.361831 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-3edcd5c6-4011-4845-a874-31293543a738 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:42.363382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-3edcd5c6-4011-4845-a874-31293543a738 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:42.364961 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3edcd5c6-4011-4845-a874-31293543a738 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1811 microversion: 2.20 time: 0.212615 Oct 01 04:20:42.365449 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 181/337] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:42 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1811 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:20:42.424856 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-33407754-a2cd-4faa-89e7-8805b6fb0112 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:42.433748 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-33407754-a2cd-4faa-89e7-8805b6fb0112 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1370 microversion: 2.1 time: 0.194557 Oct 01 04:20:42.434397 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 157/338] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:42 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1370 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:42.491399 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b9d25967-c594-4acd-8428-c521e067a155 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:42.492011 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b9d25967-c594-4acd-8428-c521e067a155 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:42.498670 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9d25967-c594-4acd-8428-c521e067a155 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:42.499159 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9d25967-c594-4acd-8428-c521e067a155 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:42.499597 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9d25967-c594-4acd-8428-c521e067a155 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:42.500299 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9d25967-c594-4acd-8428-c521e067a155 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:42.500762 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9d25967-c594-4acd-8428-c521e067a155 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:42.501360 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9d25967-c594-4acd-8428-c521e067a155 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:42.576013 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b9d25967-c594-4acd-8428-c521e067a155 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:42.584536 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b9d25967-c594-4acd-8428-c521e067a155 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1315 microversion: 2.1 time: 0.096837 Oct 01 04:20:42.585356 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 182/339] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:42 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1315 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:43.391139 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-df7f70f5-de6f-404a-a613-169e1332af30 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:43.391751 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-df7f70f5-de6f-404a-a613-169e1332af30 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:43.397858 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-df7f70f5-de6f-404a-a613-169e1332af30 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:43.398337 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-df7f70f5-de6f-404a-a613-169e1332af30 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:43.398907 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-df7f70f5-de6f-404a-a613-169e1332af30 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:43.400384 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-df7f70f5-de6f-404a-a613-169e1332af30 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:43.400828 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-df7f70f5-de6f-404a-a613-169e1332af30 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:43.401325 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-df7f70f5-de6f-404a-a613-169e1332af30 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:43.456877 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-218b84a0-93ed-42ed-9516-664e4b4971f7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:43.457508 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-218b84a0-93ed-42ed-9516-664e4b4971f7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:43.463865 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-218b84a0-93ed-42ed-9516-664e4b4971f7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:43.464345 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-218b84a0-93ed-42ed-9516-664e4b4971f7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:43.464780 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-218b84a0-93ed-42ed-9516-664e4b4971f7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:43.465508 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-218b84a0-93ed-42ed-9516-664e4b4971f7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:43.465968 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-218b84a0-93ed-42ed-9516-664e4b4971f7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:43.466390 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-218b84a0-93ed-42ed-9516-664e4b4971f7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:43.569834 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-df7f70f5-de6f-404a-a613-169e1332af30 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:43.581054 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-df7f70f5-de6f-404a-a613-169e1332af30 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:43.582814 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-df7f70f5-de6f-404a-a613-169e1332af30 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:43.584190 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-df7f70f5-de6f-404a-a613-169e1332af30 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1811 microversion: 2.20 time: 0.196953 Oct 01 04:20:43.584871 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 158/340] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:43 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1811 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:20:43.608454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e40bf051-4f92-4cff-a49a-d5fc858a311c tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:43.609134 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e40bf051-4f92-4cff-a49a-d5fc858a311c tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:43.616119 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e40bf051-4f92-4cff-a49a-d5fc858a311c tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:43.616789 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e40bf051-4f92-4cff-a49a-d5fc858a311c tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:43.617463 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e40bf051-4f92-4cff-a49a-d5fc858a311c tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:43.619730 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e40bf051-4f92-4cff-a49a-d5fc858a311c tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:43.620367 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e40bf051-4f92-4cff-a49a-d5fc858a311c tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:43.620975 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e40bf051-4f92-4cff-a49a-d5fc858a311c tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:43.622812 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-218b84a0-93ed-42ed-9516-664e4b4971f7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:43.637336 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-218b84a0-93ed-42ed-9516-664e4b4971f7 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1370 microversion: 2.1 time: 0.183989 Oct 01 04:20:43.638295 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 183/341] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:43 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1370 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:20:43.704718 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-e40bf051-4f92-4cff-a49a-d5fc858a311c tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:43.713920 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e40bf051-4f92-4cff-a49a-d5fc858a311c tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1315 microversion: 2.1 time: 0.109246 Oct 01 04:20:43.714674 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 159/342] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:43 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1315 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:43.870799 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-85f33930-e49c-42f6-9215-4e86bd500f1c req-4a5d764c-f5c8-422a-9584-cac4d7f2122f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6436bdc-2e17-43d4-a123-900e6269e551", "name": "network-vif-plugged", "status": "completed", "tag": "2a43b463-65b3-423d-b16f-bcbd2964f478"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:20:43.902989 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-85f33930-e49c-42f6-9215-4e86bd500f1c req-4a5d764c-f5c8-422a-9584-cac4d7f2122f service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:43.903569 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-85f33930-e49c-42f6-9215-4e86bd500f1c req-4a5d764c-f5c8-422a-9584-cac4d7f2122f service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:43.904095 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-85f33930-e49c-42f6-9215-4e86bd500f1c req-4a5d764c-f5c8-422a-9584-cac4d7f2122f service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:43.921129 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-85f33930-e49c-42f6-9215-4e86bd500f1c req-4a5d764c-f5c8-422a-9584-cac4d7f2122f service nova] Creating event network-vif-plugged:2a43b463-65b3-423d-b16f-bcbd2964f478 for instance c6436bdc-2e17-43d4-a123-900e6269e551 on hv-cinder-86004 Oct 01 04:20:43.926960 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-85f33930-e49c-42f6-9215-4e86bd500f1c req-4a5d764c-f5c8-422a-9584-cac4d7f2122f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064338 Oct 01 04:20:43.931519 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 184/343] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:20:44.611396 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6b167d50-3f88-4f6a-80ce-fb9a5759ba9b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:44.612191 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6b167d50-3f88-4f6a-80ce-fb9a5759ba9b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:44.620398 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b167d50-3f88-4f6a-80ce-fb9a5759ba9b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:44.621297 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b167d50-3f88-4f6a-80ce-fb9a5759ba9b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:44.622193 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b167d50-3f88-4f6a-80ce-fb9a5759ba9b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:44.623358 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b167d50-3f88-4f6a-80ce-fb9a5759ba9b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:44.624086 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b167d50-3f88-4f6a-80ce-fb9a5759ba9b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:44.624771 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6b167d50-3f88-4f6a-80ce-fb9a5759ba9b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:44.663349 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d021feab-9579-41d3-831d-70011a5877b5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:44.664363 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d021feab-9579-41d3-831d-70011a5877b5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:44.679223 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d021feab-9579-41d3-831d-70011a5877b5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:44.680792 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d021feab-9579-41d3-831d-70011a5877b5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:44.682343 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d021feab-9579-41d3-831d-70011a5877b5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:44.684364 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d021feab-9579-41d3-831d-70011a5877b5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:44.685857 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d021feab-9579-41d3-831d-70011a5877b5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:44.687345 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d021feab-9579-41d3-831d-70011a5877b5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:44.698461 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:20:44.896138 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-6b167d50-3f88-4f6a-80ce-fb9a5759ba9b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:44.899278 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d021feab-9579-41d3-831d-70011a5877b5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:44.909685 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d021feab-9579-41d3-831d-70011a5877b5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1370 microversion: 2.1 time: 0.252160 Oct 01 04:20:44.910263 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 185/344] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:44 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1370 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:44.911335 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-6b167d50-3f88-4f6a-80ce-fb9a5759ba9b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:44.913017 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-6b167d50-3f88-4f6a-80ce-fb9a5759ba9b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:44.914374 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6b167d50-3f88-4f6a-80ce-fb9a5759ba9b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1811 microversion: 2.20 time: 0.308164 Oct 01 04:20:44.914711 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8f875405-2a04-4a83-9312-9b5e8d6fb011 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:44.915059 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 160/345] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:44 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1811 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:20:44.915769 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8f875405-2a04-4a83-9312-9b5e8d6fb011 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:44.921759 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f875405-2a04-4a83-9312-9b5e8d6fb011 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:44.922240 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f875405-2a04-4a83-9312-9b5e8d6fb011 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:44.922670 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f875405-2a04-4a83-9312-9b5e8d6fb011 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:44.923354 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f875405-2a04-4a83-9312-9b5e8d6fb011 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:44.923804 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f875405-2a04-4a83-9312-9b5e8d6fb011 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:44.924222 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8f875405-2a04-4a83-9312-9b5e8d6fb011 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:45.112583 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8f875405-2a04-4a83-9312-9b5e8d6fb011 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:45.127479 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8f875405-2a04-4a83-9312-9b5e8d6fb011 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1357 microversion: 2.1 time: 0.216021 Oct 01 04:20:45.128293 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 186/346] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:44 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1357 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:45.933768 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e4c51afe-c5df-44c9-ad6a-6e6c0c900310 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:45.935250 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e4c51afe-c5df-44c9-ad6a-6e6c0c900310 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:45.940358 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ccaa6a25-b00e-483b-aaa3-e4f09c6bea29 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:45.941634 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ccaa6a25-b00e-483b-aaa3-e4f09c6bea29 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:45.950146 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ccaa6a25-b00e-483b-aaa3-e4f09c6bea29 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:45.950897 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ccaa6a25-b00e-483b-aaa3-e4f09c6bea29 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:45.951501 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ccaa6a25-b00e-483b-aaa3-e4f09c6bea29 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:45.952529 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ccaa6a25-b00e-483b-aaa3-e4f09c6bea29 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:45.953190 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ccaa6a25-b00e-483b-aaa3-e4f09c6bea29 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:45.953919 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ccaa6a25-b00e-483b-aaa3-e4f09c6bea29 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:45.956303 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4c51afe-c5df-44c9-ad6a-6e6c0c900310 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:45.957011 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4c51afe-c5df-44c9-ad6a-6e6c0c900310 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:45.957770 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4c51afe-c5df-44c9-ad6a-6e6c0c900310 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:45.958520 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4c51afe-c5df-44c9-ad6a-6e6c0c900310 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:45.958980 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4c51afe-c5df-44c9-ad6a-6e6c0c900310 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:45.959441 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e4c51afe-c5df-44c9-ad6a-6e6c0c900310 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:46.175908 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ccaa6a25-b00e-483b-aaa3-e4f09c6bea29 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:46.181296 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-e4c51afe-c5df-44c9-ad6a-6e6c0c900310 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:46.190271 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e4c51afe-c5df-44c9-ad6a-6e6c0c900310 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1370 microversion: 2.1 time: 0.261940 Oct 01 04:20:46.190767 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 161/347] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:45 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1370 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:46.191506 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ccaa6a25-b00e-483b-aaa3-e4f09c6bea29 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:46.193574 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ccaa6a25-b00e-483b-aaa3-e4f09c6bea29 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:46.194870 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ccaa6a25-b00e-483b-aaa3-e4f09c6bea29 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1811 microversion: 2.20 time: 0.258625 Oct 01 04:20:46.209198 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 187/348] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:45 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1811 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:20:46.209198 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bb612e96-8311-46dd-8d89-7535ad56edc7 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:46.209198 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bb612e96-8311-46dd-8d89-7535ad56edc7 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:46.216201 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb612e96-8311-46dd-8d89-7535ad56edc7 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:46.216700 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb612e96-8311-46dd-8d89-7535ad56edc7 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:46.217369 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb612e96-8311-46dd-8d89-7535ad56edc7 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:46.218100 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb612e96-8311-46dd-8d89-7535ad56edc7 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:46.218556 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb612e96-8311-46dd-8d89-7535ad56edc7 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:46.218984 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bb612e96-8311-46dd-8d89-7535ad56edc7 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:46.378787 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-bb612e96-8311-46dd-8d89-7535ad56edc7 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:46.386538 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bb612e96-8311-46dd-8d89-7535ad56edc7 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1357 microversion: 2.1 time: 0.189252 Oct 01 04:20:46.387110 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 188/349] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:46 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:47.214783 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3a9719d8-b52e-413e-8514-73a2bae24160 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:47.216077 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3a9719d8-b52e-413e-8514-73a2bae24160 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:47.218000 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:20:47.219095 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=14 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:20:47.226838 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a9719d8-b52e-413e-8514-73a2bae24160 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:47.227051 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-851e9d0d-1528-4254-a125-f34943099795 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:47.227705 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-851e9d0d-1528-4254-a125-f34943099795 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:47.228605 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a9719d8-b52e-413e-8514-73a2bae24160 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:47.229308 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a9719d8-b52e-413e-8514-73a2bae24160 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:47.230285 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a9719d8-b52e-413e-8514-73a2bae24160 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:47.230958 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a9719d8-b52e-413e-8514-73a2bae24160 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:47.231620 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3a9719d8-b52e-413e-8514-73a2bae24160 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:47.233113 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=8 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:20:47.235937 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-851e9d0d-1528-4254-a125-f34943099795 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:47.237532 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-851e9d0d-1528-4254-a125-f34943099795 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:47.241605 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-851e9d0d-1528-4254-a125-f34943099795 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:47.242450 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-851e9d0d-1528-4254-a125-f34943099795 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:47.243489 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-851e9d0d-1528-4254-a125-f34943099795 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:47.244010 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-851e9d0d-1528-4254-a125-f34943099795 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:47.489344 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-3a9719d8-b52e-413e-8514-73a2bae24160 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:47.492402 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-851e9d0d-1528-4254-a125-f34943099795 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:47.498443 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3a9719d8-b52e-413e-8514-73a2bae24160 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1370 microversion: 2.1 time: 0.287808 Oct 01 04:20:47.499017 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 162/350] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:47 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1370 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:47.501873 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-851e9d0d-1528-4254-a125-f34943099795 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:47.503464 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b3b69ede-1768-4e84-b989-312397b92323 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:47.503582 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-851e9d0d-1528-4254-a125-f34943099795 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:47.504199 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b3b69ede-1768-4e84-b989-312397b92323 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:47.505020 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-851e9d0d-1528-4254-a125-f34943099795 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1811 microversion: 2.20 time: 0.282810 Oct 01 04:20:47.506300 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 189/351] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:47 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1811 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:20:47.511924 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3b69ede-1768-4e84-b989-312397b92323 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:47.512695 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3b69ede-1768-4e84-b989-312397b92323 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:47.513395 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3b69ede-1768-4e84-b989-312397b92323 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:47.514463 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3b69ede-1768-4e84-b989-312397b92323 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:47.515125 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3b69ede-1768-4e84-b989-312397b92323 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:47.515550 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b3b69ede-1768-4e84-b989-312397b92323 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:47.708203 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-b3b69ede-1768-4e84-b989-312397b92323 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:47.719311 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b3b69ede-1768-4e84-b989-312397b92323 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1357 microversion: 2.1 time: 0.219151 Oct 01 04:20:47.721006 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 163/352] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:47 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1357 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:48.522612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c06d8c51-5446-4c9c-a452-5d60a61a2778 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:48.523876 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c06d8c51-5446-4c9c-a452-5d60a61a2778 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:48.534345 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-741ba337-2d95-4ad9-bdf1-43c72c005c2f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:48.534967 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c06d8c51-5446-4c9c-a452-5d60a61a2778 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:48.535078 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-741ba337-2d95-4ad9-bdf1-43c72c005c2f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:48.535374 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c06d8c51-5446-4c9c-a452-5d60a61a2778 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:48.535817 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c06d8c51-5446-4c9c-a452-5d60a61a2778 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:48.536555 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c06d8c51-5446-4c9c-a452-5d60a61a2778 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:48.537057 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c06d8c51-5446-4c9c-a452-5d60a61a2778 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:48.537489 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c06d8c51-5446-4c9c-a452-5d60a61a2778 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:48.542556 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-741ba337-2d95-4ad9-bdf1-43c72c005c2f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:48.543048 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-741ba337-2d95-4ad9-bdf1-43c72c005c2f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:48.543490 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-741ba337-2d95-4ad9-bdf1-43c72c005c2f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:48.544191 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-741ba337-2d95-4ad9-bdf1-43c72c005c2f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:48.544657 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-741ba337-2d95-4ad9-bdf1-43c72c005c2f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:48.545115 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-741ba337-2d95-4ad9-bdf1-43c72c005c2f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:48.547702 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:20:48.764438 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c06d8c51-5446-4c9c-a452-5d60a61a2778 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:48.772009 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c06d8c51-5446-4c9c-a452-5d60a61a2778 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1370 microversion: 2.1 time: 0.253648 Oct 01 04:20:48.772576 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 190/353] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:48 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1370 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:48.777501 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f4c2df53-f51c-4648-83af-dfcd7b7b78b8 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:48.778142 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f4c2df53-f51c-4648-83af-dfcd7b7b78b8 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:48.783706 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4c2df53-f51c-4648-83af-dfcd7b7b78b8 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:48.784201 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4c2df53-f51c-4648-83af-dfcd7b7b78b8 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:48.784638 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4c2df53-f51c-4648-83af-dfcd7b7b78b8 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:48.785368 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4c2df53-f51c-4648-83af-dfcd7b7b78b8 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:48.785832 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4c2df53-f51c-4648-83af-dfcd7b7b78b8 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:48.785949 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-741ba337-2d95-4ad9-bdf1-43c72c005c2f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:48.786257 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f4c2df53-f51c-4648-83af-dfcd7b7b78b8 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:48.794674 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-741ba337-2d95-4ad9-bdf1-43c72c005c2f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:48.796121 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-741ba337-2d95-4ad9-bdf1-43c72c005c2f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:48.797349 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-741ba337-2d95-4ad9-bdf1-43c72c005c2f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1811 microversion: 2.20 time: 0.266934 Oct 01 04:20:48.797913 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 164/354] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:48 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1811 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:20:48.939628 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f4c2df53-f51c-4648-83af-dfcd7b7b78b8 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:48.947655 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f4c2df53-f51c-4648-83af-dfcd7b7b78b8 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1357 microversion: 2.1 time: 0.174112 Oct 01 04:20:48.948221 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 191/355] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:48 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:49.796761 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-43b310cc-1f3b-4c7e-ad9a-e8e1277e1489 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:49.797637 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-43b310cc-1f3b-4c7e-ad9a-e8e1277e1489 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:49.807650 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43b310cc-1f3b-4c7e-ad9a-e8e1277e1489 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:49.808549 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43b310cc-1f3b-4c7e-ad9a-e8e1277e1489 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:49.809325 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43b310cc-1f3b-4c7e-ad9a-e8e1277e1489 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:49.810366 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43b310cc-1f3b-4c7e-ad9a-e8e1277e1489 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:49.811639 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43b310cc-1f3b-4c7e-ad9a-e8e1277e1489 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:49.812310 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-43b310cc-1f3b-4c7e-ad9a-e8e1277e1489 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:49.823365 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-67b1b7f7-e701-4432-9a27-5a7eb40397a0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:49.823982 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-67b1b7f7-e701-4432-9a27-5a7eb40397a0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:49.829388 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:20:49.830995 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67b1b7f7-e701-4432-9a27-5a7eb40397a0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:49.831658 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67b1b7f7-e701-4432-9a27-5a7eb40397a0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:49.832266 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67b1b7f7-e701-4432-9a27-5a7eb40397a0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:49.833233 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67b1b7f7-e701-4432-9a27-5a7eb40397a0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:49.833858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67b1b7f7-e701-4432-9a27-5a7eb40397a0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:49.834441 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67b1b7f7-e701-4432-9a27-5a7eb40397a0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:50.026150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-43b310cc-1f3b-4c7e-ad9a-e8e1277e1489 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:50.035238 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-43b310cc-1f3b-4c7e-ad9a-e8e1277e1489 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1370 microversion: 2.1 time: 0.243310 Oct 01 04:20:50.035831 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 165/356] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:49 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1370 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:50.040873 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0ff82f8c-8053-4281-aa8f-34f8190b0a49 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:50.041717 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0ff82f8c-8053-4281-aa8f-34f8190b0a49 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:50.047496 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ff82f8c-8053-4281-aa8f-34f8190b0a49 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:50.048059 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ff82f8c-8053-4281-aa8f-34f8190b0a49 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:50.048520 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ff82f8c-8053-4281-aa8f-34f8190b0a49 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:50.049568 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ff82f8c-8053-4281-aa8f-34f8190b0a49 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:50.050079 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ff82f8c-8053-4281-aa8f-34f8190b0a49 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:50.050523 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0ff82f8c-8053-4281-aa8f-34f8190b0a49 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:50.057546 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-67b1b7f7-e701-4432-9a27-5a7eb40397a0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:50.067562 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-67b1b7f7-e701-4432-9a27-5a7eb40397a0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:50.069213 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-67b1b7f7-e701-4432-9a27-5a7eb40397a0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:50.070674 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-67b1b7f7-e701-4432-9a27-5a7eb40397a0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1811 microversion: 2.20 time: 0.251244 Oct 01 04:20:50.071844 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 192/357] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:49 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1811 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:20:50.212177 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-0ff82f8c-8053-4281-aa8f-34f8190b0a49 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:50.220211 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0ff82f8c-8053-4281-aa8f-34f8190b0a49 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1357 microversion: 2.1 time: 0.183247 Oct 01 04:20:50.221181 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 166/358] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:50 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:51.064354 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-722ee0a8-e813-499c-a0e8-50cac7448cc0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:51.065131 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-722ee0a8-e813-499c-a0e8-50cac7448cc0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:51.071505 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-722ee0a8-e813-499c-a0e8-50cac7448cc0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:51.072167 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-722ee0a8-e813-499c-a0e8-50cac7448cc0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:51.072609 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-722ee0a8-e813-499c-a0e8-50cac7448cc0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:51.073488 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-722ee0a8-e813-499c-a0e8-50cac7448cc0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:51.074072 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-722ee0a8-e813-499c-a0e8-50cac7448cc0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:51.074503 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-722ee0a8-e813-499c-a0e8-50cac7448cc0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:51.099524 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e42d03f8-3b19-4669-99db-571a94d0dcbf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:51.100133 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e42d03f8-3b19-4669-99db-571a94d0dcbf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:51.107076 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e42d03f8-3b19-4669-99db-571a94d0dcbf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:51.107889 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e42d03f8-3b19-4669-99db-571a94d0dcbf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:51.108300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e42d03f8-3b19-4669-99db-571a94d0dcbf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:51.109029 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e42d03f8-3b19-4669-99db-571a94d0dcbf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:51.109485 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e42d03f8-3b19-4669-99db-571a94d0dcbf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:51.109922 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e42d03f8-3b19-4669-99db-571a94d0dcbf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:51.321792 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-722ee0a8-e813-499c-a0e8-50cac7448cc0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:51.330431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-722ee0a8-e813-499c-a0e8-50cac7448cc0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1370 microversion: 2.1 time: 0.271717 Oct 01 04:20:51.331237 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 193/359] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:51 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1370 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:51.335489 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-81365095-ab1b-43e0-80bd-7c2b39df7382 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:51.336095 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-81365095-ab1b-43e0-80bd-7c2b39df7382 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:51.340652 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-e42d03f8-3b19-4669-99db-571a94d0dcbf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:51.342608 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81365095-ab1b-43e0-80bd-7c2b39df7382 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:51.343103 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81365095-ab1b-43e0-80bd-7c2b39df7382 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:51.343547 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81365095-ab1b-43e0-80bd-7c2b39df7382 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:51.344242 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81365095-ab1b-43e0-80bd-7c2b39df7382 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:51.344700 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81365095-ab1b-43e0-80bd-7c2b39df7382 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:51.345172 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-81365095-ab1b-43e0-80bd-7c2b39df7382 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:51.355168 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-e42d03f8-3b19-4669-99db-571a94d0dcbf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:51.357170 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-e42d03f8-3b19-4669-99db-571a94d0dcbf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:51.358887 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e42d03f8-3b19-4669-99db-571a94d0dcbf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1811 microversion: 2.20 time: 0.264543 Oct 01 04:20:51.359861 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 167/360] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:51 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1811 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:20:51.487155 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-81365095-ab1b-43e0-80bd-7c2b39df7382 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:51.494638 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-81365095-ab1b-43e0-80bd-7c2b39df7382 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1357 microversion: 2.1 time: 0.162677 Oct 01 04:20:51.495193 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 194/361] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:51 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:52.358494 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-df5eecbc-a9e1-4771-86bb-ee89268d6a9c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:52.360000 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-df5eecbc-a9e1-4771-86bb-ee89268d6a9c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:52.401006 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-af44ec70-450e-40f5-a84f-bf658489742d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:52.401736 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-df5eecbc-a9e1-4771-86bb-ee89268d6a9c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:52.410852 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-af44ec70-450e-40f5-a84f-bf658489742d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:52.416016 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-df5eecbc-a9e1-4771-86bb-ee89268d6a9c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:52.416568 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-df5eecbc-a9e1-4771-86bb-ee89268d6a9c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:52.418580 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-df5eecbc-a9e1-4771-86bb-ee89268d6a9c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:52.419116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-df5eecbc-a9e1-4771-86bb-ee89268d6a9c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:52.429254 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-df5eecbc-a9e1-4771-86bb-ee89268d6a9c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:52.444472 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af44ec70-450e-40f5-a84f-bf658489742d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:52.445024 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af44ec70-450e-40f5-a84f-bf658489742d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:52.445486 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af44ec70-450e-40f5-a84f-bf658489742d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:52.448438 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af44ec70-450e-40f5-a84f-bf658489742d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:52.448979 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af44ec70-450e-40f5-a84f-bf658489742d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:52.451084 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-af44ec70-450e-40f5-a84f-bf658489742d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:52.733241 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-df5eecbc-a9e1-4771-86bb-ee89268d6a9c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:52.743112 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-df5eecbc-a9e1-4771-86bb-ee89268d6a9c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1370 microversion: 2.1 time: 0.392153 Oct 01 04:20:52.754069 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 168/362] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:52 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1370 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:52.768628 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b7ac603d-174f-4e10-91ae-be20be16e839 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:52.769392 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b7ac603d-174f-4e10-91ae-be20be16e839 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:52.798632 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b7ac603d-174f-4e10-91ae-be20be16e839 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:52.799173 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b7ac603d-174f-4e10-91ae-be20be16e839 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:52.799622 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b7ac603d-174f-4e10-91ae-be20be16e839 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:52.800378 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b7ac603d-174f-4e10-91ae-be20be16e839 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:52.800850 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b7ac603d-174f-4e10-91ae-be20be16e839 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:52.801314 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b7ac603d-174f-4e10-91ae-be20be16e839 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:52.831839 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-af44ec70-450e-40f5-a84f-bf658489742d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:52.883317 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-af44ec70-450e-40f5-a84f-bf658489742d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:52.884781 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-af44ec70-450e-40f5-a84f-bf658489742d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:52.886289 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-af44ec70-450e-40f5-a84f-bf658489742d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1811 microversion: 2.20 time: 0.502920 Oct 01 04:20:52.901969 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 195/363] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:52 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1811 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:20:53.062243 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-b7ac603d-174f-4e10-91ae-be20be16e839 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:53.072280 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b7ac603d-174f-4e10-91ae-be20be16e839 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1357 microversion: 2.1 time: 0.316593 Oct 01 04:20:53.073074 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 169/364] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:52 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1357 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:53.774069 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0ef31365-a15b-4a9e-844f-159a023f59a1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:53.775273 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0ef31365-a15b-4a9e-844f-159a023f59a1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:53.791261 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ef31365-a15b-4a9e-844f-159a023f59a1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:53.791723 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ef31365-a15b-4a9e-844f-159a023f59a1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:53.792159 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ef31365-a15b-4a9e-844f-159a023f59a1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:53.792885 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ef31365-a15b-4a9e-844f-159a023f59a1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:53.793383 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ef31365-a15b-4a9e-844f-159a023f59a1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:53.794010 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ef31365-a15b-4a9e-844f-159a023f59a1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:53.920195 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-da819667-4b31-4b00-8c7c-c705f64dc89d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:53.923704 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-da819667-4b31-4b00-8c7c-c705f64dc89d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:53.942737 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da819667-4b31-4b00-8c7c-c705f64dc89d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:53.943265 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da819667-4b31-4b00-8c7c-c705f64dc89d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:53.943722 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da819667-4b31-4b00-8c7c-c705f64dc89d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:53.944461 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da819667-4b31-4b00-8c7c-c705f64dc89d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:53.944947 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da819667-4b31-4b00-8c7c-c705f64dc89d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:53.945388 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-da819667-4b31-4b00-8c7c-c705f64dc89d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:54.021152 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0ef31365-a15b-4a9e-844f-159a023f59a1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:54.039107 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0ef31365-a15b-4a9e-844f-159a023f59a1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1370 microversion: 2.1 time: 0.265840 Oct 01 04:20:54.039742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 196/365] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:53 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1370 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:54.104552 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4031a40b-291c-423c-9b53-687afe985d75 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:54.105963 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4031a40b-291c-423c-9b53-687afe985d75 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:54.116561 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4031a40b-291c-423c-9b53-687afe985d75 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:54.117094 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4031a40b-291c-423c-9b53-687afe985d75 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:54.125467 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4031a40b-291c-423c-9b53-687afe985d75 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:54.126813 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4031a40b-291c-423c-9b53-687afe985d75 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:54.126936 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4031a40b-291c-423c-9b53-687afe985d75 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:54.127366 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4031a40b-291c-423c-9b53-687afe985d75 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:54.368875 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-da819667-4b31-4b00-8c7c-c705f64dc89d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:54.407324 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-da819667-4b31-4b00-8c7c-c705f64dc89d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:54.409295 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-da819667-4b31-4b00-8c7c-c705f64dc89d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:54.410096 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-da819667-4b31-4b00-8c7c-c705f64dc89d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1811 microversion: 2.20 time: 0.495144 Oct 01 04:20:54.412888 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 170/366] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:53 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1811 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:20:54.518993 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4031a40b-291c-423c-9b53-687afe985d75 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:54.542250 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4031a40b-291c-423c-9b53-687afe985d75 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1357 microversion: 2.1 time: 0.441280 Oct 01 04:20:54.551188 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 197/367] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:54 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1357 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:55.077798 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a9c30d22-43b3-4a85-9049-9da4267b6ac4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:55.079539 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a9c30d22-43b3-4a85-9049-9da4267b6ac4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:55.090701 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9c30d22-43b3-4a85-9049-9da4267b6ac4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:55.092441 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9c30d22-43b3-4a85-9049-9da4267b6ac4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:55.093398 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9c30d22-43b3-4a85-9049-9da4267b6ac4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:55.094411 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9c30d22-43b3-4a85-9049-9da4267b6ac4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:55.095185 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9c30d22-43b3-4a85-9049-9da4267b6ac4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:55.095833 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a9c30d22-43b3-4a85-9049-9da4267b6ac4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:55.357671 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-a9c30d22-43b3-4a85-9049-9da4267b6ac4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:55.366143 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a9c30d22-43b3-4a85-9049-9da4267b6ac4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1370 microversion: 2.1 time: 0.293133 Oct 01 04:20:55.367613 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 171/368] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:55 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1370 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:55.442732 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-924db7ca-f536-4f01-916e-80a7b46023eb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:55.443420 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-924db7ca-f536-4f01-916e-80a7b46023eb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:55.453285 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-924db7ca-f536-4f01-916e-80a7b46023eb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:55.453785 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-924db7ca-f536-4f01-916e-80a7b46023eb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:55.454262 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-924db7ca-f536-4f01-916e-80a7b46023eb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:55.454964 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-924db7ca-f536-4f01-916e-80a7b46023eb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:55.455482 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-924db7ca-f536-4f01-916e-80a7b46023eb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:55.455916 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-924db7ca-f536-4f01-916e-80a7b46023eb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:55.578163 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9e336f01-a519-40bd-a9d8-fdb413c78304 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:55.578779 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9e336f01-a519-40bd-a9d8-fdb413c78304 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:55.587918 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e336f01-a519-40bd-a9d8-fdb413c78304 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:55.588418 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e336f01-a519-40bd-a9d8-fdb413c78304 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:55.588859 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e336f01-a519-40bd-a9d8-fdb413c78304 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:55.589600 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e336f01-a519-40bd-a9d8-fdb413c78304 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:55.590063 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e336f01-a519-40bd-a9d8-fdb413c78304 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:55.590491 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9e336f01-a519-40bd-a9d8-fdb413c78304 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:55.617194 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-924db7ca-f536-4f01-916e-80a7b46023eb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:55.626558 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-924db7ca-f536-4f01-916e-80a7b46023eb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:55.628558 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-924db7ca-f536-4f01-916e-80a7b46023eb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:55.630200 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-924db7ca-f536-4f01-916e-80a7b46023eb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1811 microversion: 2.20 time: 0.191256 Oct 01 04:20:55.630782 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 198/369] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:55 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1811 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:20:55.745257 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-9e336f01-a519-40bd-a9d8-fdb413c78304 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:55.764564 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9e336f01-a519-40bd-a9d8-fdb413c78304 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1357 microversion: 2.1 time: 0.192287 Oct 01 04:20:55.765513 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 172/370] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:55 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:56.392573 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6336df03-65a1-4135-8473-92c8440687d3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:56.393667 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6336df03-65a1-4135-8473-92c8440687d3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:56.400291 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6336df03-65a1-4135-8473-92c8440687d3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:56.400783 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6336df03-65a1-4135-8473-92c8440687d3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:56.401242 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6336df03-65a1-4135-8473-92c8440687d3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:56.401946 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6336df03-65a1-4135-8473-92c8440687d3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:56.402404 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6336df03-65a1-4135-8473-92c8440687d3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:56.402828 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6336df03-65a1-4135-8473-92c8440687d3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:56.595307 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-6336df03-65a1-4135-8473-92c8440687d3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:56.603032 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6336df03-65a1-4135-8473-92c8440687d3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1370 microversion: 2.1 time: 0.216111 Oct 01 04:20:56.603583 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 199/371] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:56 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1370 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:56.658743 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9d324412-b0e2-4c7d-99f5-234f8a71695e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:56.660036 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9d324412-b0e2-4c7d-99f5-234f8a71695e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:56.666882 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d324412-b0e2-4c7d-99f5-234f8a71695e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:56.668245 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d324412-b0e2-4c7d-99f5-234f8a71695e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:56.668952 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d324412-b0e2-4c7d-99f5-234f8a71695e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:56.669853 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d324412-b0e2-4c7d-99f5-234f8a71695e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:56.670480 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d324412-b0e2-4c7d-99f5-234f8a71695e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:56.671067 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9d324412-b0e2-4c7d-99f5-234f8a71695e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:56.793067 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e350a2d0-0eb9-4073-baf2-d7761cc913e9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:56.793687 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e350a2d0-0eb9-4073-baf2-d7761cc913e9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:56.801269 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e350a2d0-0eb9-4073-baf2-d7761cc913e9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:56.802204 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e350a2d0-0eb9-4073-baf2-d7761cc913e9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:56.802647 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e350a2d0-0eb9-4073-baf2-d7761cc913e9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:56.803670 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e350a2d0-0eb9-4073-baf2-d7761cc913e9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:56.804378 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e350a2d0-0eb9-4073-baf2-d7761cc913e9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:56.804972 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e350a2d0-0eb9-4073-baf2-d7761cc913e9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:56.832970 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-9d324412-b0e2-4c7d-99f5-234f8a71695e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:56.845486 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-9d324412-b0e2-4c7d-99f5-234f8a71695e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:56.847324 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-9d324412-b0e2-4c7d-99f5-234f8a71695e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:56.848501 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9d324412-b0e2-4c7d-99f5-234f8a71695e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1753 microversion: 2.20 time: 0.195704 Oct 01 04:20:56.849969 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 173/372] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:56 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1753 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:20:56.956355 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e350a2d0-0eb9-4073-baf2-d7761cc913e9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:56.964986 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e350a2d0-0eb9-4073-baf2-d7761cc913e9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1357 microversion: 2.1 time: 0.177001 Oct 01 04:20:56.975095 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 200/373] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:56 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:20:57.098067 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-e14b9259-a101-4924-832b-b0c0d06d0f1b req-c5df6ada-2ef6-4e32-afc7-6ba171b89237 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b9af495-cd51-4492-af9f-d43ba016007b", "tag": "a9fcf58b-9af0-47d5-9218-efddc535ddda"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:20:57.107537 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:20:57.110666 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e14b9259-a101-4924-832b-b0c0d06d0f1b req-c5df6ada-2ef6-4e32-afc7-6ba171b89237 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:57.111499 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e14b9259-a101-4924-832b-b0c0d06d0f1b req-c5df6ada-2ef6-4e32-afc7-6ba171b89237 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:57.112155 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-e14b9259-a101-4924-832b-b0c0d06d0f1b req-c5df6ada-2ef6-4e32-afc7-6ba171b89237 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:57.137093 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-e14b9259-a101-4924-832b-b0c0d06d0f1b req-c5df6ada-2ef6-4e32-afc7-6ba171b89237 service nova] Creating event network-changed:a9fcf58b-9af0-47d5-9218-efddc535ddda for instance 0b9af495-cd51-4492-af9f-d43ba016007b on hv-cinder-86004 Oct 01 04:20:57.144876 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-e14b9259-a101-4924-832b-b0c0d06d0f1b req-c5df6ada-2ef6-4e32-afc7-6ba171b89237 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050418 Oct 01 04:20:57.146187 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 174/374] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:20:57.628944 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d4d04ff2-63f4-4690-bb8b-b76e0bc190e5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:57.629779 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d4d04ff2-63f4-4690-bb8b-b76e0bc190e5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:57.645782 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4d04ff2-63f4-4690-bb8b-b76e0bc190e5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:57.646593 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4d04ff2-63f4-4690-bb8b-b76e0bc190e5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:57.647037 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4d04ff2-63f4-4690-bb8b-b76e0bc190e5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:57.647780 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4d04ff2-63f4-4690-bb8b-b76e0bc190e5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:57.648229 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4d04ff2-63f4-4690-bb8b-b76e0bc190e5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:57.648697 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4d04ff2-63f4-4690-bb8b-b76e0bc190e5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:57.833475 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d4d04ff2-63f4-4690-bb8b-b76e0bc190e5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:57.837602 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:20:57.843676 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d4d04ff2-63f4-4690-bb8b-b76e0bc190e5 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1370 microversion: 2.1 time: 0.221160 Oct 01 04:20:57.844470 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 201/375] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:57 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1370 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:57.879089 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a196c0fe-de54-4b1f-8cee-b476821b22b3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:57.879894 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a196c0fe-de54-4b1f-8cee-b476821b22b3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:57.886870 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a196c0fe-de54-4b1f-8cee-b476821b22b3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:57.889061 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a196c0fe-de54-4b1f-8cee-b476821b22b3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:57.889582 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a196c0fe-de54-4b1f-8cee-b476821b22b3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:57.890425 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a196c0fe-de54-4b1f-8cee-b476821b22b3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:57.891078 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a196c0fe-de54-4b1f-8cee-b476821b22b3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:57.891512 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a196c0fe-de54-4b1f-8cee-b476821b22b3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:57.989120 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2ddf6d87-19fd-4f67-8083-cc9eac77be0f tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:57.990020 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2ddf6d87-19fd-4f67-8083-cc9eac77be0f tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:57.997169 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ddf6d87-19fd-4f67-8083-cc9eac77be0f tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:57.997908 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ddf6d87-19fd-4f67-8083-cc9eac77be0f tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:57.998536 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ddf6d87-19fd-4f67-8083-cc9eac77be0f tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:57.999252 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ddf6d87-19fd-4f67-8083-cc9eac77be0f tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:57.999792 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ddf6d87-19fd-4f67-8083-cc9eac77be0f tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:58.000227 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ddf6d87-19fd-4f67-8083-cc9eac77be0f tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:58.046036 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-a196c0fe-de54-4b1f-8cee-b476821b22b3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:58.058614 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-a196c0fe-de54-4b1f-8cee-b476821b22b3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:58.060419 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-a196c0fe-de54-4b1f-8cee-b476821b22b3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:58.061850 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a196c0fe-de54-4b1f-8cee-b476821b22b3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1753 microversion: 2.20 time: 0.187733 Oct 01 04:20:58.073551 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 175/376] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:57 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1753 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:20:58.368487 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2ddf6d87-19fd-4f67-8083-cc9eac77be0f tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:58.377716 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2ddf6d87-19fd-4f67-8083-cc9eac77be0f tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1357 microversion: 2.1 time: 0.392510 Oct 01 04:20:58.378899 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 202/377] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:57 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1357 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:20:58.867267 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0baa34bf-4fb6-4100-88d1-c18e134b560c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:58.867955 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0baa34bf-4fb6-4100-88d1-c18e134b560c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:58.882692 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0baa34bf-4fb6-4100-88d1-c18e134b560c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:58.883585 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0baa34bf-4fb6-4100-88d1-c18e134b560c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:58.883754 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0baa34bf-4fb6-4100-88d1-c18e134b560c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:58.884482 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0baa34bf-4fb6-4100-88d1-c18e134b560c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:58.886400 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0baa34bf-4fb6-4100-88d1-c18e134b560c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:58.889569 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0baa34bf-4fb6-4100-88d1-c18e134b560c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:59.090240 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e9ac6594-82f5-4ed2-b1f8-27dfcb553fce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:59.090900 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e9ac6594-82f5-4ed2-b1f8-27dfcb553fce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:59.095110 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-0baa34bf-4fb6-4100-88d1-c18e134b560c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:59.097129 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9ac6594-82f5-4ed2-b1f8-27dfcb553fce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:59.097843 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9ac6594-82f5-4ed2-b1f8-27dfcb553fce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:59.098489 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9ac6594-82f5-4ed2-b1f8-27dfcb553fce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:59.099375 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9ac6594-82f5-4ed2-b1f8-27dfcb553fce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:59.099842 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9ac6594-82f5-4ed2-b1f8-27dfcb553fce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:59.100271 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e9ac6594-82f5-4ed2-b1f8-27dfcb553fce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:59.103583 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0baa34bf-4fb6-4100-88d1-c18e134b560c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1565 microversion: 2.1 time: 0.240792 Oct 01 04:20:59.117352 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 176/378] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:58 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1565 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:20:59.127894 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a57ea862-fbdf-49d1-a5b7-e0cc8d2c7aa0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:59.128636 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a57ea862-fbdf-49d1-a5b7-e0cc8d2c7aa0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:59.135192 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a57ea862-fbdf-49d1-a5b7-e0cc8d2c7aa0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:59.135937 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a57ea862-fbdf-49d1-a5b7-e0cc8d2c7aa0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:59.136596 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a57ea862-fbdf-49d1-a5b7-e0cc8d2c7aa0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:59.137569 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a57ea862-fbdf-49d1-a5b7-e0cc8d2c7aa0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:59.138813 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a57ea862-fbdf-49d1-a5b7-e0cc8d2c7aa0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:59.139443 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a57ea862-fbdf-49d1-a5b7-e0cc8d2c7aa0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:59.254627 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a57ea862-fbdf-49d1-a5b7-e0cc8d2c7aa0 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.130948 Oct 01 04:20:59.255410 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 177/379] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 1 04:20:59 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551/os-interface => generated 285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:20:59.312698 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e9ac6594-82f5-4ed2-b1f8-27dfcb553fce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:59.329634 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e9ac6594-82f5-4ed2-b1f8-27dfcb553fce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:59.332854 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e9ac6594-82f5-4ed2-b1f8-27dfcb553fce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:59.335261 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e9ac6594-82f5-4ed2-b1f8-27dfcb553fce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.248445 Oct 01 04:20:59.337206 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 203/380] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:20:59 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:20:59.406500 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2c0e1b13-9b69-4ee2-aa10-c02e3f5dd979 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:20:59.407163 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2c0e1b13-9b69-4ee2-aa10-c02e3f5dd979 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:20:59.413932 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c0e1b13-9b69-4ee2-aa10-c02e3f5dd979 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:59.414503 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c0e1b13-9b69-4ee2-aa10-c02e3f5dd979 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:59.415169 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c0e1b13-9b69-4ee2-aa10-c02e3f5dd979 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:59.415938 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c0e1b13-9b69-4ee2-aa10-c02e3f5dd979 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:20:59.416471 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c0e1b13-9b69-4ee2-aa10-c02e3f5dd979 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:20:59.416994 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2c0e1b13-9b69-4ee2-aa10-c02e3f5dd979 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:20:59.700669 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-2c0e1b13-9b69-4ee2-aa10-c02e3f5dd979 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:20:59.714629 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2c0e1b13-9b69-4ee2-aa10-c02e3f5dd979 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1357 microversion: 2.1 time: 0.312419 Oct 01 04:20:59.715393 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 178/381] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:20:59 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1357 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:00.367618 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2f39cf21-2e93-42af-8287-ddb385b14ecf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:00.368280 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2f39cf21-2e93-42af-8287-ddb385b14ecf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:00.375917 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f39cf21-2e93-42af-8287-ddb385b14ecf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:00.376851 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f39cf21-2e93-42af-8287-ddb385b14ecf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:00.377489 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f39cf21-2e93-42af-8287-ddb385b14ecf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:00.378376 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f39cf21-2e93-42af-8287-ddb385b14ecf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:00.379000 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f39cf21-2e93-42af-8287-ddb385b14ecf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:00.379584 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2f39cf21-2e93-42af-8287-ddb385b14ecf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:00.554543 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2f39cf21-2e93-42af-8287-ddb385b14ecf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:00.565214 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2f39cf21-2e93-42af-8287-ddb385b14ecf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:00.567146 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2f39cf21-2e93-42af-8287-ddb385b14ecf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:00.568630 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2f39cf21-2e93-42af-8287-ddb385b14ecf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.208909 Oct 01 04:21:00.581703 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 204/382] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:00 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:21:00.741195 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-220210d7-bfab-4583-bd30-3ce98f329a23 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:00.742682 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-220210d7-bfab-4583-bd30-3ce98f329a23 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:00.750724 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-220210d7-bfab-4583-bd30-3ce98f329a23 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:00.751581 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-220210d7-bfab-4583-bd30-3ce98f329a23 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:00.752192 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-220210d7-bfab-4583-bd30-3ce98f329a23 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:00.753106 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-220210d7-bfab-4583-bd30-3ce98f329a23 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:00.753734 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-220210d7-bfab-4583-bd30-3ce98f329a23 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:00.754160 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-220210d7-bfab-4583-bd30-3ce98f329a23 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:00.926222 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-220210d7-bfab-4583-bd30-3ce98f329a23 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:00.938413 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-220210d7-bfab-4583-bd30-3ce98f329a23 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1357 microversion: 2.1 time: 0.201039 Oct 01 04:21:00.954524 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 179/383] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:00 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1357 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:01.045849 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-57c3f601-2b70-4f36-961b-e6c91a6ee0e7 req-7de5e540-a021-454d-8c1b-6b8760317187 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6436bdc-2e17-43d4-a123-900e6269e551", "tag": "2a43b463-65b3-423d-b16f-bcbd2964f478"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:21:01.058001 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-57c3f601-2b70-4f36-961b-e6c91a6ee0e7 req-7de5e540-a021-454d-8c1b-6b8760317187 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:01.058491 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-57c3f601-2b70-4f36-961b-e6c91a6ee0e7 req-7de5e540-a021-454d-8c1b-6b8760317187 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:01.059796 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-57c3f601-2b70-4f36-961b-e6c91a6ee0e7 req-7de5e540-a021-454d-8c1b-6b8760317187 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:01.078621 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-57c3f601-2b70-4f36-961b-e6c91a6ee0e7 req-7de5e540-a021-454d-8c1b-6b8760317187 service nova] Creating event network-changed:2a43b463-65b3-423d-b16f-bcbd2964f478 for instance c6436bdc-2e17-43d4-a123-900e6269e551 on hv-cinder-86004 Oct 01 04:21:01.083831 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-57c3f601-2b70-4f36-961b-e6c91a6ee0e7 req-7de5e540-a021-454d-8c1b-6b8760317187 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041908 Oct 01 04:21:01.084805 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 205/384] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:21:01.597924 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-23ae11ab-ccf0-4d04-90c9-95569561830e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:01.598794 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-23ae11ab-ccf0-4d04-90c9-95569561830e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:01.613558 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23ae11ab-ccf0-4d04-90c9-95569561830e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:01.614921 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23ae11ab-ccf0-4d04-90c9-95569561830e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:01.615670 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23ae11ab-ccf0-4d04-90c9-95569561830e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:01.616816 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23ae11ab-ccf0-4d04-90c9-95569561830e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:01.617473 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23ae11ab-ccf0-4d04-90c9-95569561830e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:01.618059 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23ae11ab-ccf0-4d04-90c9-95569561830e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:01.872807 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-23ae11ab-ccf0-4d04-90c9-95569561830e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:01.883077 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-23ae11ab-ccf0-4d04-90c9-95569561830e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:01.884823 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-23ae11ab-ccf0-4d04-90c9-95569561830e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:01.886566 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-23ae11ab-ccf0-4d04-90c9-95569561830e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.292573 Oct 01 04:21:01.887152 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 180/385] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:01 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:21:01.965264 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b7ab3fe1-6198-42b0-823d-476db468e8ee tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:01.966204 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b7ab3fe1-6198-42b0-823d-476db468e8ee tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:01.976205 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7ab3fe1-6198-42b0-823d-476db468e8ee tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:01.976969 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7ab3fe1-6198-42b0-823d-476db468e8ee tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:01.977605 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7ab3fe1-6198-42b0-823d-476db468e8ee tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:01.978313 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7ab3fe1-6198-42b0-823d-476db468e8ee tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:01.979030 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7ab3fe1-6198-42b0-823d-476db468e8ee tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:01.979453 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b7ab3fe1-6198-42b0-823d-476db468e8ee tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:02.143544 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b7ab3fe1-6198-42b0-823d-476db468e8ee tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:02.175397 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b7ab3fe1-6198-42b0-823d-476db468e8ee tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1357 microversion: 2.1 time: 0.214877 Oct 01 04:21:02.177643 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 206/386] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:01 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1357 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:02.917383 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-628c06d8-2668-4a53-937d-adf72b5283d1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:02.918125 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-628c06d8-2668-4a53-937d-adf72b5283d1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:02.927160 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-628c06d8-2668-4a53-937d-adf72b5283d1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:02.927611 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-628c06d8-2668-4a53-937d-adf72b5283d1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:02.928082 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-628c06d8-2668-4a53-937d-adf72b5283d1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:02.929074 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-628c06d8-2668-4a53-937d-adf72b5283d1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:02.929739 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-628c06d8-2668-4a53-937d-adf72b5283d1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:02.930520 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-628c06d8-2668-4a53-937d-adf72b5283d1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:03.083658 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-628c06d8-2668-4a53-937d-adf72b5283d1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:03.087641 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:21:03.098856 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-628c06d8-2668-4a53-937d-adf72b5283d1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:03.108753 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-628c06d8-2668-4a53-937d-adf72b5283d1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:03.110129 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-628c06d8-2668-4a53-937d-adf72b5283d1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.197366 Oct 01 04:21:03.113544 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 181/387] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:02 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:21:03.201114 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3719cfa4-95e2-4fbf-8c8f-c3b138ca81ec tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:03.202501 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3719cfa4-95e2-4fbf-8c8f-c3b138ca81ec tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:03.217548 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3719cfa4-95e2-4fbf-8c8f-c3b138ca81ec tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:03.218229 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3719cfa4-95e2-4fbf-8c8f-c3b138ca81ec tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:03.220117 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3719cfa4-95e2-4fbf-8c8f-c3b138ca81ec tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:03.221065 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3719cfa4-95e2-4fbf-8c8f-c3b138ca81ec tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:03.222547 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3719cfa4-95e2-4fbf-8c8f-c3b138ca81ec tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:03.223481 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3719cfa4-95e2-4fbf-8c8f-c3b138ca81ec tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:03.402231 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-3719cfa4-95e2-4fbf-8c8f-c3b138ca81ec tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:03.410938 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3719cfa4-95e2-4fbf-8c8f-c3b138ca81ec tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1357 microversion: 2.1 time: 0.214251 Oct 01 04:21:03.425690 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 207/388] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:03 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:03.722458 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7db8693b-aca0-449f-981a-1fd725c50993 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-951326533", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1277045486", "security_groups": [{"name": "tempest-secgroup-smoke-1256671354"}], "block_device_mapping_v2": [{"uuid": "06096119-8014-48aa-be10-d144823df947", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a58a68a2-3485-47fc-a402-341c963919cc"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:21:03.944891 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-7db8693b-aca0-449f-981a-1fd725c50993 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] validate_networks() for [('a58a68a2-3485-47fc-a402-341c963919cc', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 04:21:04.140660 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-47dcfed8-fbb6-418d-a0c7-cff6202972cf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:04.141876 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-47dcfed8-fbb6-418d-a0c7-cff6202972cf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:04.155624 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47dcfed8-fbb6-418d-a0c7-cff6202972cf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:04.157447 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47dcfed8-fbb6-418d-a0c7-cff6202972cf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:04.158223 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47dcfed8-fbb6-418d-a0c7-cff6202972cf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:04.164358 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47dcfed8-fbb6-418d-a0c7-cff6202972cf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:04.165133 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47dcfed8-fbb6-418d-a0c7-cff6202972cf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:04.165828 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47dcfed8-fbb6-418d-a0c7-cff6202972cf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:04.476011 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-47dcfed8-fbb6-418d-a0c7-cff6202972cf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:04.489576 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-47dcfed8-fbb6-418d-a0c7-cff6202972cf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:04.493039 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-47dcfed8-fbb6-418d-a0c7-cff6202972cf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:04.509264 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-47dcfed8-fbb6-418d-a0c7-cff6202972cf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.362432 Oct 01 04:21:04.510591 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 208/389] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:04 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:21:04.530328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f658713d-b05b-4582-9e6c-bbac59c8d358 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:04.535269 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f658713d-b05b-4582-9e6c-bbac59c8d358 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:04.548433 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f658713d-b05b-4582-9e6c-bbac59c8d358 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:04.549337 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f658713d-b05b-4582-9e6c-bbac59c8d358 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:04.550439 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f658713d-b05b-4582-9e6c-bbac59c8d358 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:04.551957 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f658713d-b05b-4582-9e6c-bbac59c8d358 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:04.555316 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f658713d-b05b-4582-9e6c-bbac59c8d358 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:04.556504 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f658713d-b05b-4582-9e6c-bbac59c8d358 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:04.844064 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f658713d-b05b-4582-9e6c-bbac59c8d358 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:04.855844 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f658713d-b05b-4582-9e6c-bbac59c8d358 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1357 microversion: 2.1 time: 0.342631 Oct 01 04:21:04.857464 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 209/390] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:04 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1357 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:04.889816 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-7db8693b-aca0-449f-981a-1fd725c50993 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 04:21:04.890275 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-7db8693b-aca0-449f-981a-1fd725c50993 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 04:21:04.890763 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-7db8693b-aca0-449f-981a-1fd725c50993 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 04:21:04.891190 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-7db8693b-aca0-449f-981a-1fd725c50993 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 04:21:04.891610 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-7db8693b-aca0-449f-981a-1fd725c50993 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 04:21:04.911464 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7db8693b-aca0-449f-981a-1fd725c50993 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:04.911965 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7db8693b-aca0-449f-981a-1fd725c50993 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:04.912412 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7db8693b-aca0-449f-981a-1fd725c50993 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:04.913183 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7db8693b-aca0-449f-981a-1fd725c50993 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:04.913651 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7db8693b-aca0-449f-981a-1fd725c50993 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:04.914080 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7db8693b-aca0-449f-981a-1fd725c50993 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:04.963875 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-7db8693b-aca0-449f-981a-1fd725c50993 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Getting quotas for project 721dd52b82194e4d91113d4d688900ae. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:21:04.973254 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-7db8693b-aca0-449f-981a-1fd725c50993 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Getting quotas for user dea6fd8e6a374cd5b12ec7d99f285203 and project 721dd52b82194e4d91113d4d688900ae. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:21:05.134208 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7db8693b-aca0-449f-981a-1fd725c50993 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 04:21:05.136520 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7db8693b-aca0-449f-981a-1fd725c50993 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='06096119-8014-48aa-be10-d144823df947',volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 04:21:05.405341 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7db8693b-aca0-449f-981a-1fd725c50993 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.690299 Oct 01 04:21:05.411648 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 182/391] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 1 04:21:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 04:21:05.423689 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8f0b7564-542a-43fe-adca-6edc8e16b543 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:05.424396 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8f0b7564-542a-43fe-adca-6edc8e16b543 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:05.511299 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8f0b7564-542a-43fe-adca-6edc8e16b543 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:05.520768 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8f0b7564-542a-43fe-adca-6edc8e16b543 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1094 microversion: 2.1 time: 0.102230 Oct 01 04:21:05.522154 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 210/392] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:05 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1094 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:05.542724 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-41669c01-c295-43eb-885e-502d5ebf61ab tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:05.544567 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-41669c01-c295-43eb-885e-502d5ebf61ab tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:05.559232 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41669c01-c295-43eb-885e-502d5ebf61ab tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:05.562261 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41669c01-c295-43eb-885e-502d5ebf61ab tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:05.562823 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41669c01-c295-43eb-885e-502d5ebf61ab tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:05.566809 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41669c01-c295-43eb-885e-502d5ebf61ab tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:05.567391 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41669c01-c295-43eb-885e-502d5ebf61ab tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:05.567886 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41669c01-c295-43eb-885e-502d5ebf61ab tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:05.894610 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a0e20cdb-c283-4936-9334-35ddebba0ba4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:05.896360 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a0e20cdb-c283-4936-9334-35ddebba0ba4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:05.937958 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0e20cdb-c283-4936-9334-35ddebba0ba4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:05.940756 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0e20cdb-c283-4936-9334-35ddebba0ba4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:05.941572 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0e20cdb-c283-4936-9334-35ddebba0ba4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:05.942659 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0e20cdb-c283-4936-9334-35ddebba0ba4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:05.944794 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0e20cdb-c283-4936-9334-35ddebba0ba4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:05.946807 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a0e20cdb-c283-4936-9334-35ddebba0ba4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:05.977496 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-41669c01-c295-43eb-885e-502d5ebf61ab tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:05.998747 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-41669c01-c295-43eb-885e-502d5ebf61ab tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:06.004898 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-41669c01-c295-43eb-885e-502d5ebf61ab tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:06.009154 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-41669c01-c295-43eb-885e-502d5ebf61ab tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.469533 Oct 01 04:21:06.011017 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 183/393] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:05 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:21:06.159222 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a0e20cdb-c283-4936-9334-35ddebba0ba4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:06.170547 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a0e20cdb-c283-4936-9334-35ddebba0ba4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1357 microversion: 2.1 time: 0.280988 Oct 01 04:21:06.187411 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 211/394] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:05 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1357 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:06.547212 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-23fece62-e4dc-4e4e-961d-4ffebef03788 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:06.548340 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-23fece62-e4dc-4e4e-961d-4ffebef03788 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:06.562803 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23fece62-e4dc-4e4e-961d-4ffebef03788 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:06.563531 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23fece62-e4dc-4e4e-961d-4ffebef03788 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:06.564057 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23fece62-e4dc-4e4e-961d-4ffebef03788 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:06.565324 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23fece62-e4dc-4e4e-961d-4ffebef03788 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:06.566190 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23fece62-e4dc-4e4e-961d-4ffebef03788 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:06.568371 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-23fece62-e4dc-4e4e-961d-4ffebef03788 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:06.704713 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-23fece62-e4dc-4e4e-961d-4ffebef03788 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:06.713026 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-23fece62-e4dc-4e4e-961d-4ffebef03788 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1144 microversion: 2.1 time: 0.171772 Oct 01 04:21:06.713993 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 184/395] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:06 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1144 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:07.041809 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f649b512-bdca-4884-a714-3ec340bd560d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:07.042670 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f649b512-bdca-4884-a714-3ec340bd560d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:07.054750 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f649b512-bdca-4884-a714-3ec340bd560d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:07.055527 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f649b512-bdca-4884-a714-3ec340bd560d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:07.056135 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f649b512-bdca-4884-a714-3ec340bd560d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:07.057067 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f649b512-bdca-4884-a714-3ec340bd560d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:07.058526 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f649b512-bdca-4884-a714-3ec340bd560d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:07.059158 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f649b512-bdca-4884-a714-3ec340bd560d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:07.193421 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-584c622a-16d7-4a7f-a12d-56274db7359e tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:07.194212 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-584c622a-16d7-4a7f-a12d-56274db7359e tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:07.207533 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-584c622a-16d7-4a7f-a12d-56274db7359e tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:07.208315 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-584c622a-16d7-4a7f-a12d-56274db7359e tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:07.208964 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-584c622a-16d7-4a7f-a12d-56274db7359e tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:07.209910 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-584c622a-16d7-4a7f-a12d-56274db7359e tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:07.211274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-584c622a-16d7-4a7f-a12d-56274db7359e tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:07.212454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-584c622a-16d7-4a7f-a12d-56274db7359e tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:07.303290 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f649b512-bdca-4884-a714-3ec340bd560d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:07.326387 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f649b512-bdca-4884-a714-3ec340bd560d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:07.332642 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f649b512-bdca-4884-a714-3ec340bd560d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:07.333978 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f649b512-bdca-4884-a714-3ec340bd560d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.296062 Oct 01 04:21:07.334703 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 212/396] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:07 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:21:07.502672 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-584c622a-16d7-4a7f-a12d-56274db7359e tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:07.514516 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-584c622a-16d7-4a7f-a12d-56274db7359e tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1357 microversion: 2.1 time: 0.325069 Oct 01 04:21:07.515553 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 185/397] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:07 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1357 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:07.736417 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d4852e8f-6410-49de-8984-9adb5dad0d73 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:07.737755 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d4852e8f-6410-49de-8984-9adb5dad0d73 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:07.752520 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4852e8f-6410-49de-8984-9adb5dad0d73 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:07.753268 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4852e8f-6410-49de-8984-9adb5dad0d73 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:07.753712 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4852e8f-6410-49de-8984-9adb5dad0d73 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:07.754434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4852e8f-6410-49de-8984-9adb5dad0d73 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:07.754898 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4852e8f-6410-49de-8984-9adb5dad0d73 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:07.755329 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4852e8f-6410-49de-8984-9adb5dad0d73 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:07.995431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d4852e8f-6410-49de-8984-9adb5dad0d73 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:08.018571 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d4852e8f-6410-49de-8984-9adb5dad0d73 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1144 microversion: 2.1 time: 0.285874 Oct 01 04:21:08.019160 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 213/398] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:07 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1144 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:08.364534 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-12ed94d5-6f00-463d-a238-d5bafbbc51a9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:08.366974 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-12ed94d5-6f00-463d-a238-d5bafbbc51a9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:08.379353 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12ed94d5-6f00-463d-a238-d5bafbbc51a9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:08.380142 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12ed94d5-6f00-463d-a238-d5bafbbc51a9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:08.380747 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12ed94d5-6f00-463d-a238-d5bafbbc51a9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:08.381651 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12ed94d5-6f00-463d-a238-d5bafbbc51a9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:08.382304 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12ed94d5-6f00-463d-a238-d5bafbbc51a9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:08.382879 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-12ed94d5-6f00-463d-a238-d5bafbbc51a9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:08.532833 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-12ed94d5-6f00-463d-a238-d5bafbbc51a9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:08.539471 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1cec8a56-1c65-47b9-9fa5-3e567acee744 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:08.540382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1cec8a56-1c65-47b9-9fa5-3e567acee744 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:08.543044 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-12ed94d5-6f00-463d-a238-d5bafbbc51a9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:08.547485 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cec8a56-1c65-47b9-9fa5-3e567acee744 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:08.548285 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cec8a56-1c65-47b9-9fa5-3e567acee744 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:08.548970 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cec8a56-1c65-47b9-9fa5-3e567acee744 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:08.549134 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-12ed94d5-6f00-463d-a238-d5bafbbc51a9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:08.550013 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cec8a56-1c65-47b9-9fa5-3e567acee744 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:08.550676 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-12ed94d5-6f00-463d-a238-d5bafbbc51a9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.190419 Oct 01 04:21:08.551142 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cec8a56-1c65-47b9-9fa5-3e567acee744 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:08.551789 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cec8a56-1c65-47b9-9fa5-3e567acee744 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:08.552740 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 186/399] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:08 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:21:08.716414 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1cec8a56-1c65-47b9-9fa5-3e567acee744 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:08.724385 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1cec8a56-1c65-47b9-9fa5-3e567acee744 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1357 microversion: 2.1 time: 0.188560 Oct 01 04:21:08.725590 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 214/400] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:08 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:08.973772 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-98323515-7d0a-4926-9f18-6945019761c3 req-e11f4348-0e12-41a8-b9d2-f22924f61313 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b9af495-cd51-4492-af9f-d43ba016007b", "name": "network-vif-plugged", "status": "completed", "tag": "a9fcf58b-9af0-47d5-9218-efddc535ddda"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:21:08.998305 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-98323515-7d0a-4926-9f18-6945019761c3 req-e11f4348-0e12-41a8-b9d2-f22924f61313 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:09.002543 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-98323515-7d0a-4926-9f18-6945019761c3 req-e11f4348-0e12-41a8-b9d2-f22924f61313 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:09.005065 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-98323515-7d0a-4926-9f18-6945019761c3 req-e11f4348-0e12-41a8-b9d2-f22924f61313 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:09.051981 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ebd91a52-cf73-4dd0-82f2-4b39580df414 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:09.054267 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ebd91a52-cf73-4dd0-82f2-4b39580df414 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:09.069737 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-98323515-7d0a-4926-9f18-6945019761c3 req-e11f4348-0e12-41a8-b9d2-f22924f61313 service nova] Creating event network-vif-plugged:a9fcf58b-9af0-47d5-9218-efddc535ddda for instance 0b9af495-cd51-4492-af9f-d43ba016007b on hv-cinder-86004 Oct 01 04:21:09.078240 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebd91a52-cf73-4dd0-82f2-4b39580df414 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:09.081145 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebd91a52-cf73-4dd0-82f2-4b39580df414 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:09.084640 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebd91a52-cf73-4dd0-82f2-4b39580df414 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:09.086330 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebd91a52-cf73-4dd0-82f2-4b39580df414 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:09.091568 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebd91a52-cf73-4dd0-82f2-4b39580df414 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:09.092666 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ebd91a52-cf73-4dd0-82f2-4b39580df414 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:09.093324 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-98323515-7d0a-4926-9f18-6945019761c3 req-e11f4348-0e12-41a8-b9d2-f22924f61313 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119467 Oct 01 04:21:09.094399 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 187/401] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:21:09.222473 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ebd91a52-cf73-4dd0-82f2-4b39580df414 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:09.236230 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ebd91a52-cf73-4dd0-82f2-4b39580df414 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1144 microversion: 2.1 time: 0.191744 Oct 01 04:21:09.238018 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 215/402] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:09 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1144 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:09.586086 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0c49424d-57b2-418c-90e4-58a19cfb4ded tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:09.588418 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0c49424d-57b2-418c-90e4-58a19cfb4ded tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:09.607066 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c49424d-57b2-418c-90e4-58a19cfb4ded tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:09.607856 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c49424d-57b2-418c-90e4-58a19cfb4ded tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:09.608479 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c49424d-57b2-418c-90e4-58a19cfb4ded tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:09.609408 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c49424d-57b2-418c-90e4-58a19cfb4ded tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:09.610030 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c49424d-57b2-418c-90e4-58a19cfb4ded tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:09.610619 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0c49424d-57b2-418c-90e4-58a19cfb4ded tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:09.753534 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6374b161-42a8-4264-b7da-ce8129b24ef7 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:09.754899 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6374b161-42a8-4264-b7da-ce8129b24ef7 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:09.766382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6374b161-42a8-4264-b7da-ce8129b24ef7 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:09.767132 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6374b161-42a8-4264-b7da-ce8129b24ef7 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:09.767856 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6374b161-42a8-4264-b7da-ce8129b24ef7 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:09.769840 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6374b161-42a8-4264-b7da-ce8129b24ef7 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:09.773821 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6374b161-42a8-4264-b7da-ce8129b24ef7 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:09.774714 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6374b161-42a8-4264-b7da-ce8129b24ef7 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:09.967799 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-0c49424d-57b2-418c-90e4-58a19cfb4ded tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:09.979263 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-0c49424d-57b2-418c-90e4-58a19cfb4ded tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:09.980658 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-0c49424d-57b2-418c-90e4-58a19cfb4ded tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:09.986467 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0c49424d-57b2-418c-90e4-58a19cfb4ded tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.406665 Oct 01 04:21:09.991811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 188/403] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:09 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:21:10.015402 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-6374b161-42a8-4264-b7da-ce8129b24ef7 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:10.027096 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6374b161-42a8-4264-b7da-ce8129b24ef7 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1357 microversion: 2.1 time: 0.277635 Oct 01 04:21:10.028515 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 216/404] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:09 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1357 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:21:10.262528 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-28af17ff-0e38-4de0-98a4-320fa412efbe tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:10.264121 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-28af17ff-0e38-4de0-98a4-320fa412efbe tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:10.309443 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-28af17ff-0e38-4de0-98a4-320fa412efbe tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:10.324785 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-28af17ff-0e38-4de0-98a4-320fa412efbe tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:10.326325 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-28af17ff-0e38-4de0-98a4-320fa412efbe tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:10.335144 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-28af17ff-0e38-4de0-98a4-320fa412efbe tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:10.336154 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-28af17ff-0e38-4de0-98a4-320fa412efbe tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:10.336992 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-28af17ff-0e38-4de0-98a4-320fa412efbe tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:10.517633 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-28af17ff-0e38-4de0-98a4-320fa412efbe tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:10.539207 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-28af17ff-0e38-4de0-98a4-320fa412efbe tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1144 microversion: 2.1 time: 0.281916 Oct 01 04:21:10.557474 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 189/405] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:10 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1144 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:11.017713 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cf6fd9a4-30d6-41e2-8439-24a22b75f729 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:11.021792 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cf6fd9a4-30d6-41e2-8439-24a22b75f729 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:11.044730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf6fd9a4-30d6-41e2-8439-24a22b75f729 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:11.052026 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a1808d60-5069-4a5b-bf81-33ed82ca97c1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:11.054006 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a1808d60-5069-4a5b-bf81-33ed82ca97c1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:11.061004 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf6fd9a4-30d6-41e2-8439-24a22b75f729 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:11.067340 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf6fd9a4-30d6-41e2-8439-24a22b75f729 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:11.070196 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf6fd9a4-30d6-41e2-8439-24a22b75f729 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:11.074030 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf6fd9a4-30d6-41e2-8439-24a22b75f729 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:11.077372 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cf6fd9a4-30d6-41e2-8439-24a22b75f729 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:11.078340 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a1808d60-5069-4a5b-bf81-33ed82ca97c1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:11.081113 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a1808d60-5069-4a5b-bf81-33ed82ca97c1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:11.084513 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a1808d60-5069-4a5b-bf81-33ed82ca97c1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:11.089429 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a1808d60-5069-4a5b-bf81-33ed82ca97c1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:11.093094 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a1808d60-5069-4a5b-bf81-33ed82ca97c1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:11.098095 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a1808d60-5069-4a5b-bf81-33ed82ca97c1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:11.501246 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-cf6fd9a4-30d6-41e2-8439-24a22b75f729 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:11.520342 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-a1808d60-5069-4a5b-bf81-33ed82ca97c1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:11.526190 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-cf6fd9a4-30d6-41e2-8439-24a22b75f729 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:11.532529 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a1808d60-5069-4a5b-bf81-33ed82ca97c1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1357 microversion: 2.1 time: 0.485107 Oct 01 04:21:11.534327 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-cf6fd9a4-30d6-41e2-8439-24a22b75f729 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:11.536423 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cf6fd9a4-30d6-41e2-8439-24a22b75f729 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.524781 Oct 01 04:21:11.536886 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 190/406] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:11 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1357 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:11.551907 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 217/407] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:11 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:21:11.574644 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-54cd9e8d-809a-49f8-99ac-b089b8ac8358 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:11.578400 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-54cd9e8d-809a-49f8-99ac-b089b8ac8358 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:11.594123 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54cd9e8d-809a-49f8-99ac-b089b8ac8358 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:11.597434 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54cd9e8d-809a-49f8-99ac-b089b8ac8358 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:11.598724 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54cd9e8d-809a-49f8-99ac-b089b8ac8358 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:11.600469 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54cd9e8d-809a-49f8-99ac-b089b8ac8358 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:11.602842 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54cd9e8d-809a-49f8-99ac-b089b8ac8358 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:11.604153 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-54cd9e8d-809a-49f8-99ac-b089b8ac8358 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:11.736191 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-54cd9e8d-809a-49f8-99ac-b089b8ac8358 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:11.752712 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-54cd9e8d-809a-49f8-99ac-b089b8ac8358 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1192 microversion: 2.1 time: 0.183870 Oct 01 04:21:11.753787 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 191/408] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:11 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1192 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:12.575450 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9a36e357-2784-42d3-a898-3b4169b1be2a tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:12.576086 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9a36e357-2784-42d3-a898-3b4169b1be2a tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:12.580606 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8e2d9d28-2175-47e9-a588-2b673b549c9c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:12.581419 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8e2d9d28-2175-47e9-a588-2b673b549c9c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:12.589918 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e2d9d28-2175-47e9-a588-2b673b549c9c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:12.591124 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a36e357-2784-42d3-a898-3b4169b1be2a tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:12.591969 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a36e357-2784-42d3-a898-3b4169b1be2a tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:12.592786 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a36e357-2784-42d3-a898-3b4169b1be2a tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:12.593618 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a36e357-2784-42d3-a898-3b4169b1be2a tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:12.594089 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a36e357-2784-42d3-a898-3b4169b1be2a tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:12.594518 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9a36e357-2784-42d3-a898-3b4169b1be2a tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:12.601483 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e2d9d28-2175-47e9-a588-2b673b549c9c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:12.602984 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e2d9d28-2175-47e9-a588-2b673b549c9c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:12.603791 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e2d9d28-2175-47e9-a588-2b673b549c9c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:12.604305 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e2d9d28-2175-47e9-a588-2b673b549c9c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:12.604743 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e2d9d28-2175-47e9-a588-2b673b549c9c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:12.960594 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-9a36e357-2784-42d3-a898-3b4169b1be2a tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:12.971063 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-8e2d9d28-2175-47e9-a588-2b673b549c9c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:12.974552 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9a36e357-2784-42d3-a898-3b4169b1be2a tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1357 microversion: 2.1 time: 0.402949 Oct 01 04:21:12.975225 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 218/409] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:12 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1357 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:12.987941 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cca3c519-a71c-4308-888c-8baefab09809 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:12.987941 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cca3c519-a71c-4308-888c-8baefab09809 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:12.988357 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-8e2d9d28-2175-47e9-a588-2b673b549c9c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:12.988357 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-8e2d9d28-2175-47e9-a588-2b673b549c9c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:12.988357 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8e2d9d28-2175-47e9-a588-2b673b549c9c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.416522 Oct 01 04:21:12.988658 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 192/410] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:12 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:21:13.000841 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cca3c519-a71c-4308-888c-8baefab09809 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:13.001442 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cca3c519-a71c-4308-888c-8baefab09809 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:13.001962 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cca3c519-a71c-4308-888c-8baefab09809 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:13.002682 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cca3c519-a71c-4308-888c-8baefab09809 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:13.004838 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cca3c519-a71c-4308-888c-8baefab09809 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:13.005314 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cca3c519-a71c-4308-888c-8baefab09809 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:13.111490 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-cca3c519-a71c-4308-888c-8baefab09809 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:13.121222 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cca3c519-a71c-4308-888c-8baefab09809 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1192 microversion: 2.1 time: 0.144830 Oct 01 04:21:13.124970 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 219/411] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:12 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1192 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:14.002874 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cca8d700-b5e9-4d5f-be6b-a019614cb575 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:14.003421 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cca8d700-b5e9-4d5f-be6b-a019614cb575 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:14.009511 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cca8d700-b5e9-4d5f-be6b-a019614cb575 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:14.009990 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cca8d700-b5e9-4d5f-be6b-a019614cb575 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:14.010422 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cca8d700-b5e9-4d5f-be6b-a019614cb575 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:14.011104 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cca8d700-b5e9-4d5f-be6b-a019614cb575 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:14.011652 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cca8d700-b5e9-4d5f-be6b-a019614cb575 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:14.012089 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cca8d700-b5e9-4d5f-be6b-a019614cb575 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:14.017269 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4b8c1280-c876-4825-8dd8-45842604326e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:14.017876 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4b8c1280-c876-4825-8dd8-45842604326e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:14.023670 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b8c1280-c876-4825-8dd8-45842604326e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:14.024411 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b8c1280-c876-4825-8dd8-45842604326e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:14.024845 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b8c1280-c876-4825-8dd8-45842604326e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:14.025627 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b8c1280-c876-4825-8dd8-45842604326e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:14.026082 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b8c1280-c876-4825-8dd8-45842604326e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:14.026509 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4b8c1280-c876-4825-8dd8-45842604326e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:14.031727 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:21:14.218682 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-cca8d700-b5e9-4d5f-be6b-a019614cb575 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:14.222878 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4b8c1280-c876-4825-8dd8-45842604326e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:14.226264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cca8d700-b5e9-4d5f-be6b-a019614cb575 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1357 microversion: 2.1 time: 0.227455 Oct 01 04:21:14.226884 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 193/412] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:13 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:14.232021 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4696fdde-2b27-4cd7-b7df-9528e55dfe0b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:14.232228 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4b8c1280-c876-4825-8dd8-45842604326e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:14.233278 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4696fdde-2b27-4cd7-b7df-9528e55dfe0b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:14.233980 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4b8c1280-c876-4825-8dd8-45842604326e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:14.235163 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4b8c1280-c876-4825-8dd8-45842604326e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.221831 Oct 01 04:21:14.239762 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4696fdde-2b27-4cd7-b7df-9528e55dfe0b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:14.240452 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4696fdde-2b27-4cd7-b7df-9528e55dfe0b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:14.241086 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4696fdde-2b27-4cd7-b7df-9528e55dfe0b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:14.241937 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4696fdde-2b27-4cd7-b7df-9528e55dfe0b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:14.242604 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4696fdde-2b27-4cd7-b7df-9528e55dfe0b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:14.242843 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 220/413] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:14 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:21:14.243369 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4696fdde-2b27-4cd7-b7df-9528e55dfe0b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:14.306684 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-4696fdde-2b27-4cd7-b7df-9528e55dfe0b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:14.314404 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4696fdde-2b27-4cd7-b7df-9528e55dfe0b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1192 microversion: 2.1 time: 0.086576 Oct 01 04:21:14.314970 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 194/414] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:14 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1192 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:15.252437 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5c519709-c1b9-4e92-8dbd-82161266bf28 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:15.254044 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5c519709-c1b9-4e92-8dbd-82161266bf28 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:15.261542 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c0ecd25a-3128-4d3f-9334-bb975a0dd412 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:15.262643 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c519709-c1b9-4e92-8dbd-82161266bf28 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:15.262791 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c519709-c1b9-4e92-8dbd-82161266bf28 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:15.263325 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c519709-c1b9-4e92-8dbd-82161266bf28 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:15.264078 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c519709-c1b9-4e92-8dbd-82161266bf28 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:15.264573 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c0ecd25a-3128-4d3f-9334-bb975a0dd412 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:15.264718 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c519709-c1b9-4e92-8dbd-82161266bf28 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:15.265236 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c519709-c1b9-4e92-8dbd-82161266bf28 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:15.266807 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:21:15.267625 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:21:15.274961 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0ecd25a-3128-4d3f-9334-bb975a0dd412 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:15.275568 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0ecd25a-3128-4d3f-9334-bb975a0dd412 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:15.276073 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0ecd25a-3128-4d3f-9334-bb975a0dd412 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:15.276877 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0ecd25a-3128-4d3f-9334-bb975a0dd412 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:15.277444 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0ecd25a-3128-4d3f-9334-bb975a0dd412 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:15.278652 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0ecd25a-3128-4d3f-9334-bb975a0dd412 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:15.518431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-5c519709-c1b9-4e92-8dbd-82161266bf28 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:15.520767 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:21:15.528755 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5c519709-c1b9-4e92-8dbd-82161266bf28 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1547 microversion: 2.1 time: 0.282104 Oct 01 04:21:15.529595 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 221/415] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:15 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1547 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:15.533611 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c0ecd25a-3128-4d3f-9334-bb975a0dd412 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:15.534193 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0f82d102-ac49-4a17-be30-bc12df307c7c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:15.534798 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0f82d102-ac49-4a17-be30-bc12df307c7c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:15.541178 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f82d102-ac49-4a17-be30-bc12df307c7c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:15.542254 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f82d102-ac49-4a17-be30-bc12df307c7c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:15.542894 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f82d102-ac49-4a17-be30-bc12df307c7c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:15.543945 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f82d102-ac49-4a17-be30-bc12df307c7c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:15.544596 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f82d102-ac49-4a17-be30-bc12df307c7c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:15.545250 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c0ecd25a-3128-4d3f-9334-bb975a0dd412 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:15.545445 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f82d102-ac49-4a17-be30-bc12df307c7c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:15.546829 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c0ecd25a-3128-4d3f-9334-bb975a0dd412 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:15.548145 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c0ecd25a-3128-4d3f-9334-bb975a0dd412 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.290757 Oct 01 04:21:15.549672 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 195/416] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:15 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:21:15.557434 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cdb9fd1e-c3eb-4691-9815-aaa58e8c63ac tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:15.558199 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cdb9fd1e-c3eb-4691-9815-aaa58e8c63ac tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:15.565900 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdb9fd1e-c3eb-4691-9815-aaa58e8c63ac tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:15.566384 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdb9fd1e-c3eb-4691-9815-aaa58e8c63ac tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:15.566817 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdb9fd1e-c3eb-4691-9815-aaa58e8c63ac tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:15.567510 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdb9fd1e-c3eb-4691-9815-aaa58e8c63ac tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:15.568085 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdb9fd1e-c3eb-4691-9815-aaa58e8c63ac tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:15.568653 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cdb9fd1e-c3eb-4691-9815-aaa58e8c63ac tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:15.617813 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0f82d102-ac49-4a17-be30-bc12df307c7c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:15.625686 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0f82d102-ac49-4a17-be30-bc12df307c7c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1192 microversion: 2.1 time: 0.095080 Oct 01 04:21:15.626264 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 222/417] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:15 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1192 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:15.714811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-cdb9fd1e-c3eb-4691-9815-aaa58e8c63ac tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:15.723832 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cdb9fd1e-c3eb-4691-9815-aaa58e8c63ac tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1547 microversion: 2.1 time: 0.173053 Oct 01 04:21:15.724415 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 196/418] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:15 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1547 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:15.746008 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-990bb710-7d29-4547-a59c-c331267d3ad3 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:15.751735 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-990bb710-7d29-4547-a59c-c331267d3ad3 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:15.752743 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-990bb710-7d29-4547-a59c-c331267d3ad3 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Searching by: {'deleted': False, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a'} {{(pid=120598) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 01 04:21:15.759336 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-990bb710-7d29-4547-a59c-c331267d3ad3 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:15.759809 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-990bb710-7d29-4547-a59c-c331267d3ad3 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:15.760253 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-990bb710-7d29-4547-a59c-c331267d3ad3 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:15.760960 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-990bb710-7d29-4547-a59c-c331267d3ad3 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:15.761414 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-990bb710-7d29-4547-a59c-c331267d3ad3 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:15.761913 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-990bb710-7d29-4547-a59c-c331267d3ad3 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:15.857964 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.multi_cell_list [None req-990bb710-7d29-4547-a59c-c331267d3ad3 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120598) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 01 04:21:15.960844 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-990bb710-7d29-4547-a59c-c331267d3ad3 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.218521 Oct 01 04:21:15.961652 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 223/419] 10.222.0.26 () {58 vars in 1125 bytes} [Sat Oct 1 04:21:15 2022] GET /compute/v2.1/servers => generated 342 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:21:15.975133 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7da33084-07d9-4fb0-abf9-0fbf1a18d466 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:15.976038 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7da33084-07d9-4fb0-abf9-0fbf1a18d466 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:15.982096 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7da33084-07d9-4fb0-abf9-0fbf1a18d466 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:15.982856 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7da33084-07d9-4fb0-abf9-0fbf1a18d466 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:15.983297 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7da33084-07d9-4fb0-abf9-0fbf1a18d466 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:15.983993 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7da33084-07d9-4fb0-abf9-0fbf1a18d466 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:15.984445 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7da33084-07d9-4fb0-abf9-0fbf1a18d466 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:15.985126 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7da33084-07d9-4fb0-abf9-0fbf1a18d466 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:16.132444 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-7da33084-07d9-4fb0-abf9-0fbf1a18d466 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:16.143294 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7da33084-07d9-4fb0-abf9-0fbf1a18d466 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1547 microversion: 2.1 time: 0.172159 Oct 01 04:21:16.144081 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 197/420] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:15 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1547 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:21:16.578332 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8339f14b-ac34-4076-bf75-d36428871bef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:16.579813 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8339f14b-ac34-4076-bf75-d36428871bef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:16.586511 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8339f14b-ac34-4076-bf75-d36428871bef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:16.587316 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8339f14b-ac34-4076-bf75-d36428871bef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:16.587955 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8339f14b-ac34-4076-bf75-d36428871bef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:16.588887 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8339f14b-ac34-4076-bf75-d36428871bef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:16.589746 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8339f14b-ac34-4076-bf75-d36428871bef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:16.590965 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8339f14b-ac34-4076-bf75-d36428871bef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:16.648159 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b02eab01-8a89-433a-b6c3-a6bfcca85012 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:16.649203 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b02eab01-8a89-433a-b6c3-a6bfcca85012 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:16.659628 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b02eab01-8a89-433a-b6c3-a6bfcca85012 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:16.660228 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b02eab01-8a89-433a-b6c3-a6bfcca85012 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:16.660741 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b02eab01-8a89-433a-b6c3-a6bfcca85012 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:16.662123 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b02eab01-8a89-433a-b6c3-a6bfcca85012 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:16.663330 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b02eab01-8a89-433a-b6c3-a6bfcca85012 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:16.664770 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b02eab01-8a89-433a-b6c3-a6bfcca85012 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:16.772292 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-b02eab01-8a89-433a-b6c3-a6bfcca85012 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:16.785756 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b02eab01-8a89-433a-b6c3-a6bfcca85012 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1210 microversion: 2.1 time: 0.141887 Oct 01 04:21:16.801243 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 198/421] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:16 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1210 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:21:16.909263 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8339f14b-ac34-4076-bf75-d36428871bef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:16.919546 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8339f14b-ac34-4076-bf75-d36428871bef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:16.921599 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8339f14b-ac34-4076-bf75-d36428871bef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:16.923128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8339f14b-ac34-4076-bf75-d36428871bef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.352419 Oct 01 04:21:16.924165 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 224/422] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:16 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:21:17.760913 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-18e348c8-8270-4c3c-99be-a3f872cb4177 req-fa6a4830-60ae-4fe2-830f-d57bdd9cd95b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b31127e-af32-4116-90df-f27354ee55f4", "tag": "12264ff5-12ea-4894-9a40-7cdf57c7ecb0"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:21:17.786030 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-18e348c8-8270-4c3c-99be-a3f872cb4177 req-fa6a4830-60ae-4fe2-830f-d57bdd9cd95b service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:17.786624 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-18e348c8-8270-4c3c-99be-a3f872cb4177 req-fa6a4830-60ae-4fe2-830f-d57bdd9cd95b service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:17.787138 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-18e348c8-8270-4c3c-99be-a3f872cb4177 req-fa6a4830-60ae-4fe2-830f-d57bdd9cd95b service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:17.806337 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-18e348c8-8270-4c3c-99be-a3f872cb4177 req-fa6a4830-60ae-4fe2-830f-d57bdd9cd95b service nova] Creating event network-changed:12264ff5-12ea-4894-9a40-7cdf57c7ecb0 for instance 1b31127e-af32-4116-90df-f27354ee55f4 on hv-cinder-86004 Oct 01 04:21:17.810952 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-88b9f98d-a730-4927-96d1-e2dafc4457e5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:17.812432 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-88b9f98d-a730-4927-96d1-e2dafc4457e5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:17.814771 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-18e348c8-8270-4c3c-99be-a3f872cb4177 req-fa6a4830-60ae-4fe2-830f-d57bdd9cd95b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057263 Oct 01 04:21:17.816278 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 199/423] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:21:17.822270 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88b9f98d-a730-4927-96d1-e2dafc4457e5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:17.822703 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88b9f98d-a730-4927-96d1-e2dafc4457e5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:17.826964 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88b9f98d-a730-4927-96d1-e2dafc4457e5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:17.827699 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88b9f98d-a730-4927-96d1-e2dafc4457e5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:17.828170 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88b9f98d-a730-4927-96d1-e2dafc4457e5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:17.828599 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88b9f98d-a730-4927-96d1-e2dafc4457e5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:17.868909 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a0421275-f64f-43e7-ac05-9bdf4012351e tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6785570e-683c-4aa8-8e5f-644aae69585f"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:21:17.872535 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a0421275-f64f-43e7-ac05-9bdf4012351e tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:17.879945 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0421275-f64f-43e7-ac05-9bdf4012351e tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:17.880443 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0421275-f64f-43e7-ac05-9bdf4012351e tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:17.881119 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0421275-f64f-43e7-ac05-9bdf4012351e tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:17.882090 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0421275-f64f-43e7-ac05-9bdf4012351e tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:17.885331 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0421275-f64f-43e7-ac05-9bdf4012351e tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:17.886304 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0421275-f64f-43e7-ac05-9bdf4012351e tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:17.911524 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:21:18.010416 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-88b9f98d-a730-4927-96d1-e2dafc4457e5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:18.020546 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-88b9f98d-a730-4927-96d1-e2dafc4457e5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1266 microversion: 2.1 time: 0.214082 Oct 01 04:21:18.021195 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 225/424] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:17 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:18.042836 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-74aeff66-13a4-45be-b4b5-56505a569b90 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:18.044757 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-74aeff66-13a4-45be-b4b5-56505a569b90 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:18.053121 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74aeff66-13a4-45be-b4b5-56505a569b90 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:18.054039 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74aeff66-13a4-45be-b4b5-56505a569b90 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:18.054850 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74aeff66-13a4-45be-b4b5-56505a569b90 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:18.056172 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74aeff66-13a4-45be-b4b5-56505a569b90 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:18.057448 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74aeff66-13a4-45be-b4b5-56505a569b90 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:18.058380 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-74aeff66-13a4-45be-b4b5-56505a569b90 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:18.248716 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-74aeff66-13a4-45be-b4b5-56505a569b90 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:18.255933 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a0421275-f64f-43e7-ac05-9bdf4012351e tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "POST /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.392291 Oct 01 04:21:18.260118 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-74aeff66-13a4-45be-b4b5-56505a569b90 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:18.262041 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 200/425] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 1 04:21:17 2022] POST /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b/os-volume_attachments => generated 194 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:21:18.265590 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-74aeff66-13a4-45be-b4b5-56505a569b90 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:18.267159 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-74aeff66-13a4-45be-b4b5-56505a569b90 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.232246 Oct 01 04:21:18.267706 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 226/426] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:18 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:21:19.057050 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fd2326f1-bd0e-4888-9b88-c9ccb9f90848 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:19.057865 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fd2326f1-bd0e-4888-9b88-c9ccb9f90848 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:19.066092 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd2326f1-bd0e-4888-9b88-c9ccb9f90848 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:19.066585 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd2326f1-bd0e-4888-9b88-c9ccb9f90848 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:19.068109 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd2326f1-bd0e-4888-9b88-c9ccb9f90848 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:19.068819 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd2326f1-bd0e-4888-9b88-c9ccb9f90848 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:19.069822 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd2326f1-bd0e-4888-9b88-c9ccb9f90848 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:19.070257 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fd2326f1-bd0e-4888-9b88-c9ccb9f90848 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:19.215114 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-fd2326f1-bd0e-4888-9b88-c9ccb9f90848 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:19.223295 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fd2326f1-bd0e-4888-9b88-c9ccb9f90848 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1266 microversion: 2.1 time: 0.174185 Oct 01 04:21:19.223805 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 201/427] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:19 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:19.294018 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8b8689fc-04a7-46d7-9ad4-a33043aa8c0b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:19.294650 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8b8689fc-04a7-46d7-9ad4-a33043aa8c0b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:19.300592 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b8689fc-04a7-46d7-9ad4-a33043aa8c0b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:19.301119 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b8689fc-04a7-46d7-9ad4-a33043aa8c0b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:19.301585 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b8689fc-04a7-46d7-9ad4-a33043aa8c0b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:19.302274 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b8689fc-04a7-46d7-9ad4-a33043aa8c0b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:19.302728 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b8689fc-04a7-46d7-9ad4-a33043aa8c0b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:19.303149 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8b8689fc-04a7-46d7-9ad4-a33043aa8c0b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:19.436768 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8b8689fc-04a7-46d7-9ad4-a33043aa8c0b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:19.445348 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8b8689fc-04a7-46d7-9ad4-a33043aa8c0b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:19.446789 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8b8689fc-04a7-46d7-9ad4-a33043aa8c0b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:19.447938 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8b8689fc-04a7-46d7-9ad4-a33043aa8c0b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.158420 Oct 01 04:21:19.448495 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 227/428] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:19 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:21:20.247010 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7b6a2eff-c907-4162-a1ce-2da52818bce1 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:20.247628 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7b6a2eff-c907-4162-a1ce-2da52818bce1 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:20.253997 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b6a2eff-c907-4162-a1ce-2da52818bce1 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:20.254478 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b6a2eff-c907-4162-a1ce-2da52818bce1 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:20.254911 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b6a2eff-c907-4162-a1ce-2da52818bce1 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:20.255601 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b6a2eff-c907-4162-a1ce-2da52818bce1 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:20.256057 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b6a2eff-c907-4162-a1ce-2da52818bce1 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:20.256476 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7b6a2eff-c907-4162-a1ce-2da52818bce1 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:20.387700 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-7b6a2eff-c907-4162-a1ce-2da52818bce1 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:20.396949 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7b6a2eff-c907-4162-a1ce-2da52818bce1 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1266 microversion: 2.1 time: 0.154172 Oct 01 04:21:20.397522 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 202/429] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:20 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:20.473831 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7deb436c-19f9-4983-a5f6-41aa60af5057 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:20.474521 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7deb436c-19f9-4983-a5f6-41aa60af5057 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:20.476386 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=74 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:21:20.482086 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7deb436c-19f9-4983-a5f6-41aa60af5057 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:20.482564 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7deb436c-19f9-4983-a5f6-41aa60af5057 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:20.482992 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7deb436c-19f9-4983-a5f6-41aa60af5057 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:20.483673 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7deb436c-19f9-4983-a5f6-41aa60af5057 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:20.484121 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7deb436c-19f9-4983-a5f6-41aa60af5057 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:20.484546 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7deb436c-19f9-4983-a5f6-41aa60af5057 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:20.617304 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7deb436c-19f9-4983-a5f6-41aa60af5057 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:20.626588 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7deb436c-19f9-4983-a5f6-41aa60af5057 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:20.628013 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7deb436c-19f9-4983-a5f6-41aa60af5057 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:20.629184 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7deb436c-19f9-4983-a5f6-41aa60af5057 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.159199 Oct 01 04:21:20.629740 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 228/430] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:20 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:21:21.420985 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8a6fe4bb-646e-4f9b-8c0c-e63cdf713152 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:21.421903 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8a6fe4bb-646e-4f9b-8c0c-e63cdf713152 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:21.428835 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a6fe4bb-646e-4f9b-8c0c-e63cdf713152 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:21.429346 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a6fe4bb-646e-4f9b-8c0c-e63cdf713152 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:21.429779 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a6fe4bb-646e-4f9b-8c0c-e63cdf713152 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:21.430474 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a6fe4bb-646e-4f9b-8c0c-e63cdf713152 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:21.430928 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a6fe4bb-646e-4f9b-8c0c-e63cdf713152 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:21.431372 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8a6fe4bb-646e-4f9b-8c0c-e63cdf713152 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:21.565115 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-8a6fe4bb-646e-4f9b-8c0c-e63cdf713152 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:21.572744 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8a6fe4bb-646e-4f9b-8c0c-e63cdf713152 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1266 microversion: 2.1 time: 0.156957 Oct 01 04:21:21.573334 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 203/431] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:21 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:21.655103 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-61cbe887-7d64-4aa3-b1a3-23f737a88c1f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:21.655790 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-61cbe887-7d64-4aa3-b1a3-23f737a88c1f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:21.662105 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61cbe887-7d64-4aa3-b1a3-23f737a88c1f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:21.662585 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61cbe887-7d64-4aa3-b1a3-23f737a88c1f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:21.663019 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61cbe887-7d64-4aa3-b1a3-23f737a88c1f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:21.663712 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61cbe887-7d64-4aa3-b1a3-23f737a88c1f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:21.664167 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61cbe887-7d64-4aa3-b1a3-23f737a88c1f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:21.664591 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-61cbe887-7d64-4aa3-b1a3-23f737a88c1f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:21.802473 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-61cbe887-7d64-4aa3-b1a3-23f737a88c1f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:21.811957 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-61cbe887-7d64-4aa3-b1a3-23f737a88c1f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:21.813433 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-61cbe887-7d64-4aa3-b1a3-23f737a88c1f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:21.814579 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-61cbe887-7d64-4aa3-b1a3-23f737a88c1f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.163944 Oct 01 04:21:21.815159 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 229/432] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:21 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:21:22.595461 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3b061339-d917-4c23-a325-559de0709011 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:22.596071 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3b061339-d917-4c23-a325-559de0709011 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:22.602428 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b061339-d917-4c23-a325-559de0709011 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:22.602909 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b061339-d917-4c23-a325-559de0709011 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:22.603348 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b061339-d917-4c23-a325-559de0709011 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:22.604033 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b061339-d917-4c23-a325-559de0709011 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:22.604487 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b061339-d917-4c23-a325-559de0709011 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:22.604906 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b061339-d917-4c23-a325-559de0709011 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:22.733476 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-3b061339-d917-4c23-a325-559de0709011 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:22.741054 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3b061339-d917-4c23-a325-559de0709011 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1266 microversion: 2.1 time: 0.149301 Oct 01 04:21:22.741615 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 204/433] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:22 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:22.839955 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-26fea7f0-4d1c-4bb6-b83c-29e6f67a0c79 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:22.840560 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-26fea7f0-4d1c-4bb6-b83c-29e6f67a0c79 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:22.846725 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26fea7f0-4d1c-4bb6-b83c-29e6f67a0c79 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:22.847215 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26fea7f0-4d1c-4bb6-b83c-29e6f67a0c79 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:22.847653 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26fea7f0-4d1c-4bb6-b83c-29e6f67a0c79 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:22.848343 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26fea7f0-4d1c-4bb6-b83c-29e6f67a0c79 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:22.848830 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26fea7f0-4d1c-4bb6-b83c-29e6f67a0c79 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:22.849280 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26fea7f0-4d1c-4bb6-b83c-29e6f67a0c79 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:22.978441 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-26fea7f0-4d1c-4bb6-b83c-29e6f67a0c79 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:22.987667 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-26fea7f0-4d1c-4bb6-b83c-29e6f67a0c79 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:22.989132 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-26fea7f0-4d1c-4bb6-b83c-29e6f67a0c79 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:22.990268 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-26fea7f0-4d1c-4bb6-b83c-29e6f67a0c79 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.154188 Oct 01 04:21:22.990822 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 230/434] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:22 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:21:23.763880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0a1b94bf-867b-48e4-b940-cc306249b038 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:23.764527 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0a1b94bf-867b-48e4-b940-cc306249b038 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:23.770937 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a1b94bf-867b-48e4-b940-cc306249b038 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:23.771429 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a1b94bf-867b-48e4-b940-cc306249b038 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:23.771873 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a1b94bf-867b-48e4-b940-cc306249b038 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:23.772653 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a1b94bf-867b-48e4-b940-cc306249b038 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:23.773099 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a1b94bf-867b-48e4-b940-cc306249b038 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:23.773529 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0a1b94bf-867b-48e4-b940-cc306249b038 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:23.901244 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-0a1b94bf-867b-48e4-b940-cc306249b038 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:23.909624 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0a1b94bf-867b-48e4-b940-cc306249b038 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1266 microversion: 2.1 time: 0.149843 Oct 01 04:21:23.910184 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 205/435] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:23 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:24.016390 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b1575faa-006a-438f-bead-535da90b4f2f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:24.017030 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b1575faa-006a-438f-bead-535da90b4f2f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:24.023016 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1575faa-006a-438f-bead-535da90b4f2f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:24.023441 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1575faa-006a-438f-bead-535da90b4f2f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:24.024167 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1575faa-006a-438f-bead-535da90b4f2f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:24.024858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1575faa-006a-438f-bead-535da90b4f2f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:24.025343 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1575faa-006a-438f-bead-535da90b4f2f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:24.025768 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b1575faa-006a-438f-bead-535da90b4f2f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:24.162418 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b1575faa-006a-438f-bead-535da90b4f2f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:24.171805 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b1575faa-006a-438f-bead-535da90b4f2f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:24.173265 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b1575faa-006a-438f-bead-535da90b4f2f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:24.174411 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b1575faa-006a-438f-bead-535da90b4f2f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.162441 Oct 01 04:21:24.174995 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 231/436] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:24 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:21:24.670913 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-15f009cb-d779-493d-a670-6e890c5bcf2d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:24.671451 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-15f009cb-d779-493d-a670-6e890c5bcf2d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:24.678493 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-15f009cb-d779-493d-a670-6e890c5bcf2d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:24.679201 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-15f009cb-d779-493d-a670-6e890c5bcf2d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:24.679999 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-15f009cb-d779-493d-a670-6e890c5bcf2d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:24.681308 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-15f009cb-d779-493d-a670-6e890c5bcf2d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:24.682102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-15f009cb-d779-493d-a670-6e890c5bcf2d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:24.682543 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-15f009cb-d779-493d-a670-6e890c5bcf2d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:24.811621 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-15f009cb-d779-493d-a670-6e890c5bcf2d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lazy-loading 'services' on Instance uuid c2643a3f-906d-4cb4-8b4f-f2a63557ab69 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:21:24.924271 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-15f009cb-d779-493d-a670-6e890c5bcf2d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69/os-volume_attachments/ac1f5ede-cb5c-4137-80b9-52416c28cbf0" status: 202 len: 0 microversion: 2.1 time: 0.258037 Oct 01 04:21:24.924852 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 206/437] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 1 04:21:24 2022] DELETE /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69/os-volume_attachments/ac1f5ede-cb5c-4137-80b9-52416c28cbf0 => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 04:21:24.932468 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f893e9ef-e861-4ab8-bc48-a8d2a51cc62c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:24.933107 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f893e9ef-e861-4ab8-bc48-a8d2a51cc62c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:24.939360 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f893e9ef-e861-4ab8-bc48-a8d2a51cc62c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:24.939847 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f893e9ef-e861-4ab8-bc48-a8d2a51cc62c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:24.940277 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f893e9ef-e861-4ab8-bc48-a8d2a51cc62c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:24.941000 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f893e9ef-e861-4ab8-bc48-a8d2a51cc62c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:24.941458 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f893e9ef-e861-4ab8-bc48-a8d2a51cc62c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:24.941879 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f893e9ef-e861-4ab8-bc48-a8d2a51cc62c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:25.202794 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-82518dbb-c8ba-407b-b796-ac65b9bd7bed tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:25.203604 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-82518dbb-c8ba-407b-b796-ac65b9bd7bed tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:25.209957 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82518dbb-c8ba-407b-b796-ac65b9bd7bed tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:25.210445 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82518dbb-c8ba-407b-b796-ac65b9bd7bed tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:25.210883 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82518dbb-c8ba-407b-b796-ac65b9bd7bed tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:25.211608 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82518dbb-c8ba-407b-b796-ac65b9bd7bed tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:25.212065 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82518dbb-c8ba-407b-b796-ac65b9bd7bed tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:25.212489 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82518dbb-c8ba-407b-b796-ac65b9bd7bed tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:25.264051 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f893e9ef-e861-4ab8-bc48-a8d2a51cc62c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:25.272306 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f893e9ef-e861-4ab8-bc48-a8d2a51cc62c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1266 microversion: 2.1 time: 0.343503 Oct 01 04:21:25.272966 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 232/438] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:24 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1266 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:21:25.348893 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-82518dbb-c8ba-407b-b796-ac65b9bd7bed tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:25.357593 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-82518dbb-c8ba-407b-b796-ac65b9bd7bed tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:25.359014 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-82518dbb-c8ba-407b-b796-ac65b9bd7bed tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:25.360188 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-82518dbb-c8ba-407b-b796-ac65b9bd7bed tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.162996 Oct 01 04:21:25.360984 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 207/439] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:25 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:21:26.295438 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-250295ec-aecb-4f67-b5f9-b60843bcfb3d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:26.296078 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-250295ec-aecb-4f67-b5f9-b60843bcfb3d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:26.298044 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:21:26.303483 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-250295ec-aecb-4f67-b5f9-b60843bcfb3d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:26.303965 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-250295ec-aecb-4f67-b5f9-b60843bcfb3d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:26.304395 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-250295ec-aecb-4f67-b5f9-b60843bcfb3d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:26.305105 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-250295ec-aecb-4f67-b5f9-b60843bcfb3d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:26.305561 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-250295ec-aecb-4f67-b5f9-b60843bcfb3d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:26.305979 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-250295ec-aecb-4f67-b5f9-b60843bcfb3d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:26.386109 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1b4b0338-9964-4b4c-9c17-05c759c93ae1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:26.386708 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1b4b0338-9964-4b4c-9c17-05c759c93ae1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:26.393279 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b4b0338-9964-4b4c-9c17-05c759c93ae1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:26.393763 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b4b0338-9964-4b4c-9c17-05c759c93ae1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:26.394192 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b4b0338-9964-4b4c-9c17-05c759c93ae1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:26.394917 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b4b0338-9964-4b4c-9c17-05c759c93ae1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:26.395436 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b4b0338-9964-4b4c-9c17-05c759c93ae1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:26.395860 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1b4b0338-9964-4b4c-9c17-05c759c93ae1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:26.453135 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-250295ec-aecb-4f67-b5f9-b60843bcfb3d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:26.460908 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-250295ec-aecb-4f67-b5f9-b60843bcfb3d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1266 microversion: 2.1 time: 0.169297 Oct 01 04:21:26.461512 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 233/440] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:26 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:26.537122 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-1b4b0338-9964-4b4c-9c17-05c759c93ae1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:26.546148 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-1b4b0338-9964-4b4c-9c17-05c759c93ae1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:26.547576 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-1b4b0338-9964-4b4c-9c17-05c759c93ae1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:26.548728 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1b4b0338-9964-4b4c-9c17-05c759c93ae1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.166598 Oct 01 04:21:26.549327 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 208/441] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:26 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:21:27.483768 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a91c848f-3f16-4f6c-83d3-0f175af79313 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:27.484371 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a91c848f-3f16-4f6c-83d3-0f175af79313 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:27.490266 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a91c848f-3f16-4f6c-83d3-0f175af79313 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:27.490740 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a91c848f-3f16-4f6c-83d3-0f175af79313 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:27.491173 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a91c848f-3f16-4f6c-83d3-0f175af79313 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:27.491849 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a91c848f-3f16-4f6c-83d3-0f175af79313 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:27.492295 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a91c848f-3f16-4f6c-83d3-0f175af79313 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:27.492715 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a91c848f-3f16-4f6c-83d3-0f175af79313 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:27.574328 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-50419a48-c132-42fe-aef4-c7bfb264d47e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:27.575600 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-50419a48-c132-42fe-aef4-c7bfb264d47e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:27.578135 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:21:27.583406 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50419a48-c132-42fe-aef4-c7bfb264d47e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:27.584091 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50419a48-c132-42fe-aef4-c7bfb264d47e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:27.584555 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50419a48-c132-42fe-aef4-c7bfb264d47e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:27.585283 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50419a48-c132-42fe-aef4-c7bfb264d47e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:27.585738 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50419a48-c132-42fe-aef4-c7bfb264d47e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:27.586324 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50419a48-c132-42fe-aef4-c7bfb264d47e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:27.629914 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a91c848f-3f16-4f6c-83d3-0f175af79313 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:27.638396 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a91c848f-3f16-4f6c-83d3-0f175af79313 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1266 microversion: 2.1 time: 0.157818 Oct 01 04:21:27.638968 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 234/442] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:27 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:27.724771 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-50419a48-c132-42fe-aef4-c7bfb264d47e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:27.733376 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-50419a48-c132-42fe-aef4-c7bfb264d47e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:27.734883 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-50419a48-c132-42fe-aef4-c7bfb264d47e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:27.736020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-50419a48-c132-42fe-aef4-c7bfb264d47e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.165469 Oct 01 04:21:27.736576 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 209/443] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:27 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:21:28.661792 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0e65d9c0-7282-422b-a8e3-2247f630a9d5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:28.662451 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0e65d9c0-7282-422b-a8e3-2247f630a9d5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:28.668619 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e65d9c0-7282-422b-a8e3-2247f630a9d5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:28.669152 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e65d9c0-7282-422b-a8e3-2247f630a9d5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:28.669688 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e65d9c0-7282-422b-a8e3-2247f630a9d5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:28.670389 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e65d9c0-7282-422b-a8e3-2247f630a9d5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:28.670856 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e65d9c0-7282-422b-a8e3-2247f630a9d5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:28.671290 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e65d9c0-7282-422b-a8e3-2247f630a9d5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:28.760701 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4574da9b-0e24-45c2-bdb0-8850bbb6e216 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:28.761472 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4574da9b-0e24-45c2-bdb0-8850bbb6e216 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:28.768564 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4574da9b-0e24-45c2-bdb0-8850bbb6e216 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:28.769088 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4574da9b-0e24-45c2-bdb0-8850bbb6e216 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:28.769526 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4574da9b-0e24-45c2-bdb0-8850bbb6e216 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:28.770222 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4574da9b-0e24-45c2-bdb0-8850bbb6e216 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:28.770680 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4574da9b-0e24-45c2-bdb0-8850bbb6e216 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:28.771104 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4574da9b-0e24-45c2-bdb0-8850bbb6e216 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:28.801085 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0e65d9c0-7282-422b-a8e3-2247f630a9d5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:28.808788 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0e65d9c0-7282-422b-a8e3-2247f630a9d5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1266 microversion: 2.1 time: 0.150903 Oct 01 04:21:28.809464 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 235/444] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:28 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:28.905617 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-4574da9b-0e24-45c2-bdb0-8850bbb6e216 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:28.914338 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-4574da9b-0e24-45c2-bdb0-8850bbb6e216 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:28.915713 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-4574da9b-0e24-45c2-bdb0-8850bbb6e216 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:28.916874 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4574da9b-0e24-45c2-bdb0-8850bbb6e216 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.160032 Oct 01 04:21:28.917461 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 210/445] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:28 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:21:29.831677 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7b283326-63c8-4f29-8181-944d1cb5a6e5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:29.832221 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7b283326-63c8-4f29-8181-944d1cb5a6e5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:29.838165 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b283326-63c8-4f29-8181-944d1cb5a6e5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:29.838647 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b283326-63c8-4f29-8181-944d1cb5a6e5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:29.839084 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b283326-63c8-4f29-8181-944d1cb5a6e5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:29.839771 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b283326-63c8-4f29-8181-944d1cb5a6e5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:29.840229 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b283326-63c8-4f29-8181-944d1cb5a6e5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:29.841342 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7b283326-63c8-4f29-8181-944d1cb5a6e5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:29.859836 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:21:29.941612 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eb6b3b2f-6b7d-48ce-8d3e-34517993117e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:29.942206 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-eb6b3b2f-6b7d-48ce-8d3e-34517993117e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:29.948898 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb6b3b2f-6b7d-48ce-8d3e-34517993117e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:29.949763 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb6b3b2f-6b7d-48ce-8d3e-34517993117e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:29.950246 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb6b3b2f-6b7d-48ce-8d3e-34517993117e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:29.951347 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb6b3b2f-6b7d-48ce-8d3e-34517993117e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:29.951906 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb6b3b2f-6b7d-48ce-8d3e-34517993117e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:29.952412 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eb6b3b2f-6b7d-48ce-8d3e-34517993117e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:29.975582 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7b283326-63c8-4f29-8181-944d1cb5a6e5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:29.984147 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7b283326-63c8-4f29-8181-944d1cb5a6e5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1266 microversion: 2.1 time: 0.156381 Oct 01 04:21:29.984721 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 236/446] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:29 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:30.084862 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-eb6b3b2f-6b7d-48ce-8d3e-34517993117e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:30.093957 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-eb6b3b2f-6b7d-48ce-8d3e-34517993117e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:30.095422 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-eb6b3b2f-6b7d-48ce-8d3e-34517993117e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:30.096588 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-eb6b3b2f-6b7d-48ce-8d3e-34517993117e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.158834 Oct 01 04:21:30.097173 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 211/447] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:29 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:21:31.006023 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-54bcbc3f-2132-48f1-b42f-2f80686de246 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:31.006642 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-54bcbc3f-2132-48f1-b42f-2f80686de246 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:31.012709 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54bcbc3f-2132-48f1-b42f-2f80686de246 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:31.013240 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54bcbc3f-2132-48f1-b42f-2f80686de246 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:31.013686 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54bcbc3f-2132-48f1-b42f-2f80686de246 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:31.014397 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54bcbc3f-2132-48f1-b42f-2f80686de246 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:31.014859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54bcbc3f-2132-48f1-b42f-2f80686de246 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:31.015289 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54bcbc3f-2132-48f1-b42f-2f80686de246 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:31.123467 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-955ceeab-0299-44e4-a43d-5d5695d92bd1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:31.124073 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-955ceeab-0299-44e4-a43d-5d5695d92bd1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:31.130499 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-955ceeab-0299-44e4-a43d-5d5695d92bd1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:31.131217 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-955ceeab-0299-44e4-a43d-5d5695d92bd1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:31.131425 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-955ceeab-0299-44e4-a43d-5d5695d92bd1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:31.132266 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-955ceeab-0299-44e4-a43d-5d5695d92bd1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:31.132768 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-955ceeab-0299-44e4-a43d-5d5695d92bd1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:31.133222 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-955ceeab-0299-44e4-a43d-5d5695d92bd1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:31.147864 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-54bcbc3f-2132-48f1-b42f-2f80686de246 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:31.155998 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-54bcbc3f-2132-48f1-b42f-2f80686de246 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1266 microversion: 2.1 time: 0.153724 Oct 01 04:21:31.156570 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 237/448] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:31 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:31.266031 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-955ceeab-0299-44e4-a43d-5d5695d92bd1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:31.275311 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-955ceeab-0299-44e4-a43d-5d5695d92bd1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:31.276741 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-955ceeab-0299-44e4-a43d-5d5695d92bd1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:31.278441 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-955ceeab-0299-44e4-a43d-5d5695d92bd1 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.159240 Oct 01 04:21:31.279001 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 212/449] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:31 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:21:32.179492 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b621be9c-2364-4649-99d6-1242bf4790c2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:32.180116 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b621be9c-2364-4649-99d6-1242bf4790c2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:32.186249 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b621be9c-2364-4649-99d6-1242bf4790c2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:32.186741 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b621be9c-2364-4649-99d6-1242bf4790c2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:32.187184 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b621be9c-2364-4649-99d6-1242bf4790c2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:32.187878 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b621be9c-2364-4649-99d6-1242bf4790c2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:32.188338 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b621be9c-2364-4649-99d6-1242bf4790c2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:32.188874 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b621be9c-2364-4649-99d6-1242bf4790c2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:32.303574 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-70e1fbe1-aa32-499a-8558-6c495fbfb4e0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:32.304082 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-70e1fbe1-aa32-499a-8558-6c495fbfb4e0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:32.310443 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-70e1fbe1-aa32-499a-8558-6c495fbfb4e0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:32.310927 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-70e1fbe1-aa32-499a-8558-6c495fbfb4e0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:32.311361 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-70e1fbe1-aa32-499a-8558-6c495fbfb4e0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:32.312053 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-70e1fbe1-aa32-499a-8558-6c495fbfb4e0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:32.312542 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-70e1fbe1-aa32-499a-8558-6c495fbfb4e0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:32.312988 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-70e1fbe1-aa32-499a-8558-6c495fbfb4e0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:32.323858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b621be9c-2364-4649-99d6-1242bf4790c2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:32.331810 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b621be9c-2364-4649-99d6-1242bf4790c2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1266 microversion: 2.1 time: 0.156161 Oct 01 04:21:32.332389 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 238/450] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:32 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:32.441589 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-70e1fbe1-aa32-499a-8558-6c495fbfb4e0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:32.450553 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-70e1fbe1-aa32-499a-8558-6c495fbfb4e0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:32.451984 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-70e1fbe1-aa32-499a-8558-6c495fbfb4e0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:32.453161 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-70e1fbe1-aa32-499a-8558-6c495fbfb4e0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.153488 Oct 01 04:21:32.453717 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 213/451] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:32 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:21:33.355066 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-25e45baf-f9bf-46ed-9a9d-33ab95d5922e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:33.355613 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-25e45baf-f9bf-46ed-9a9d-33ab95d5922e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:33.362084 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25e45baf-f9bf-46ed-9a9d-33ab95d5922e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:33.362564 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25e45baf-f9bf-46ed-9a9d-33ab95d5922e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:33.362996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25e45baf-f9bf-46ed-9a9d-33ab95d5922e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:33.363677 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25e45baf-f9bf-46ed-9a9d-33ab95d5922e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:33.364134 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25e45baf-f9bf-46ed-9a9d-33ab95d5922e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:33.364554 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25e45baf-f9bf-46ed-9a9d-33ab95d5922e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:33.479184 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-53187c55-838d-414d-a1ae-521a074807d6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:33.479904 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-53187c55-838d-414d-a1ae-521a074807d6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:33.487128 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-53187c55-838d-414d-a1ae-521a074807d6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:33.487612 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-53187c55-838d-414d-a1ae-521a074807d6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:33.488047 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-53187c55-838d-414d-a1ae-521a074807d6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:33.488745 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-53187c55-838d-414d-a1ae-521a074807d6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:33.489229 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-53187c55-838d-414d-a1ae-521a074807d6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:33.489656 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-53187c55-838d-414d-a1ae-521a074807d6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:33.501837 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-25e45baf-f9bf-46ed-9a9d-33ab95d5922e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:33.509621 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-25e45baf-f9bf-46ed-9a9d-33ab95d5922e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1266 microversion: 2.1 time: 0.158468 Oct 01 04:21:33.510198 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 239/452] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:33 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:33.622525 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-53187c55-838d-414d-a1ae-521a074807d6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:33.630989 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-53187c55-838d-414d-a1ae-521a074807d6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:33.632430 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-53187c55-838d-414d-a1ae-521a074807d6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:33.633727 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-53187c55-838d-414d-a1ae-521a074807d6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.158376 Oct 01 04:21:33.634286 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 214/453] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:33 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:21:34.534518 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-13df36eb-8ca1-46f7-9113-60b33b569117 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:34.535419 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-13df36eb-8ca1-46f7-9113-60b33b569117 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:34.541493 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13df36eb-8ca1-46f7-9113-60b33b569117 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:34.542221 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13df36eb-8ca1-46f7-9113-60b33b569117 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:34.542668 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13df36eb-8ca1-46f7-9113-60b33b569117 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:34.543368 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13df36eb-8ca1-46f7-9113-60b33b569117 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:34.543825 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13df36eb-8ca1-46f7-9113-60b33b569117 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:34.544252 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13df36eb-8ca1-46f7-9113-60b33b569117 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:34.659613 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-af3346e8-fc6e-4356-b9fa-62f4692d2e4e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:34.660440 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-af3346e8-fc6e-4356-b9fa-62f4692d2e4e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:34.666964 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af3346e8-fc6e-4356-b9fa-62f4692d2e4e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:34.667658 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af3346e8-fc6e-4356-b9fa-62f4692d2e4e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:34.668091 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af3346e8-fc6e-4356-b9fa-62f4692d2e4e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:34.668792 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af3346e8-fc6e-4356-b9fa-62f4692d2e4e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:34.669270 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af3346e8-fc6e-4356-b9fa-62f4692d2e4e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:34.670469 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-af3346e8-fc6e-4356-b9fa-62f4692d2e4e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:34.675226 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:21:34.680801 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-13df36eb-8ca1-46f7-9113-60b33b569117 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:34.690391 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-13df36eb-8ca1-46f7-9113-60b33b569117 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1266 microversion: 2.1 time: 0.160268 Oct 01 04:21:34.691157 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 240/454] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:34 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:34.809984 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-af3346e8-fc6e-4356-b9fa-62f4692d2e4e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:34.819157 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-af3346e8-fc6e-4356-b9fa-62f4692d2e4e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:34.820576 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-af3346e8-fc6e-4356-b9fa-62f4692d2e4e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:34.821767 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-af3346e8-fc6e-4356-b9fa-62f4692d2e4e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.166312 Oct 01 04:21:34.822313 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 215/455] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:34 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:21:35.448279 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8a1c2316-41d9-4fdd-a644-1e7fb1a76f46 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:35.448890 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8a1c2316-41d9-4fdd-a644-1e7fb1a76f46 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:35.455268 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a1c2316-41d9-4fdd-a644-1e7fb1a76f46 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:35.455755 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a1c2316-41d9-4fdd-a644-1e7fb1a76f46 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:35.456181 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a1c2316-41d9-4fdd-a644-1e7fb1a76f46 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:35.456878 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a1c2316-41d9-4fdd-a644-1e7fb1a76f46 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:35.457400 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a1c2316-41d9-4fdd-a644-1e7fb1a76f46 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:35.457782 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8a1c2316-41d9-4fdd-a644-1e7fb1a76f46 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:35.588103 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4affb5b4-3cea-4f4e-8496-7ccab6a8ab2f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:21:35.596592 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4affb5b4-3cea-4f4e-8496-7ccab6a8ab2f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:35.597095 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4affb5b4-3cea-4f4e-8496-7ccab6a8ab2f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:35.597534 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4affb5b4-3cea-4f4e-8496-7ccab6a8ab2f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:35.621700 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4affb5b4-3cea-4f4e-8496-7ccab6a8ab2f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Going to try to stop instance {{(pid=120597) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 01 04:21:35.625434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8a1c2316-41d9-4fdd-a644-1e7fb1a76f46 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:35.635682 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8a1c2316-41d9-4fdd-a644-1e7fb1a76f46 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1593 microversion: 2.1 time: 0.191122 Oct 01 04:21:35.636259 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 241/456] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:35 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1593 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:35.681130 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4affb5b4-3cea-4f4e-8496-7ccab6a8ab2f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "POST /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69/action" status: 202 len: 0 microversion: 2.1 time: 0.096972 Oct 01 04:21:35.681713 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 216/457] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 1 04:21:35 2022] POST /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 01 04:21:35.690359 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-97a15755-b1d3-430a-b631-396265c38a04 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:35.691152 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-97a15755-b1d3-430a-b631-396265c38a04 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:35.697218 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97a15755-b1d3-430a-b631-396265c38a04 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:35.697756 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97a15755-b1d3-430a-b631-396265c38a04 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:35.698277 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97a15755-b1d3-430a-b631-396265c38a04 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:35.699207 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97a15755-b1d3-430a-b631-396265c38a04 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:35.699777 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97a15755-b1d3-430a-b631-396265c38a04 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:35.700356 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97a15755-b1d3-430a-b631-396265c38a04 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:35.719128 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-84fc5ca7-098e-4194-b87d-5534765b3246 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:35.719413 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-84fc5ca7-098e-4194-b87d-5534765b3246 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:35.727083 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84fc5ca7-098e-4194-b87d-5534765b3246 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:35.728479 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84fc5ca7-098e-4194-b87d-5534765b3246 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:35.729235 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84fc5ca7-098e-4194-b87d-5534765b3246 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:35.730184 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84fc5ca7-098e-4194-b87d-5534765b3246 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:35.730639 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84fc5ca7-098e-4194-b87d-5534765b3246 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:35.731077 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84fc5ca7-098e-4194-b87d-5534765b3246 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:35.893684 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-97a15755-b1d3-430a-b631-396265c38a04 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:35.903636 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-97a15755-b1d3-430a-b631-396265c38a04 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1677 microversion: 2.1 time: 0.216527 Oct 01 04:21:35.905213 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 242/458] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:35 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1677 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:35.924166 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-84fc5ca7-098e-4194-b87d-5534765b3246 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:35.924574 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bf9d3773-5ab1-43ad-a655-949245ada67b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:35.925493 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bf9d3773-5ab1-43ad-a655-949245ada67b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:35.931745 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf9d3773-5ab1-43ad-a655-949245ada67b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:35.932319 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf9d3773-5ab1-43ad-a655-949245ada67b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:35.932834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf9d3773-5ab1-43ad-a655-949245ada67b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:35.932966 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-84fc5ca7-098e-4194-b87d-5534765b3246 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1266 microversion: 2.1 time: 0.220670 Oct 01 04:21:35.933690 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf9d3773-5ab1-43ad-a655-949245ada67b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:35.935732 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 217/459] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:35 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:21:35.935846 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf9d3773-5ab1-43ad-a655-949245ada67b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:35.935846 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf9d3773-5ab1-43ad-a655-949245ada67b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:36.069196 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-bf9d3773-5ab1-43ad-a655-949245ada67b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:36.078506 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-bf9d3773-5ab1-43ad-a655-949245ada67b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:36.079939 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-bf9d3773-5ab1-43ad-a655-949245ada67b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:36.081123 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bf9d3773-5ab1-43ad-a655-949245ada67b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.164620 Oct 01 04:21:36.081677 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 243/460] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:35 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:21:36.933841 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-064fd12c-814c-4a54-9498-19ea064bf517 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:36.935788 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-064fd12c-814c-4a54-9498-19ea064bf517 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:36.942415 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-064fd12c-814c-4a54-9498-19ea064bf517 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:36.942900 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-064fd12c-814c-4a54-9498-19ea064bf517 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:36.943334 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-064fd12c-814c-4a54-9498-19ea064bf517 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:36.944031 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-064fd12c-814c-4a54-9498-19ea064bf517 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:36.944658 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-064fd12c-814c-4a54-9498-19ea064bf517 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:36.945241 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-064fd12c-814c-4a54-9498-19ea064bf517 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:36.955758 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3751b0de-7ead-4c83-b3d2-d50296582706 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:36.956362 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3751b0de-7ead-4c83-b3d2-d50296582706 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:36.972362 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3751b0de-7ead-4c83-b3d2-d50296582706 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:36.973151 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3751b0de-7ead-4c83-b3d2-d50296582706 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:36.973747 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3751b0de-7ead-4c83-b3d2-d50296582706 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:36.974452 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3751b0de-7ead-4c83-b3d2-d50296582706 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:36.974981 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3751b0de-7ead-4c83-b3d2-d50296582706 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:36.975325 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3751b0de-7ead-4c83-b3d2-d50296582706 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:37.215458 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-064fd12c-814c-4a54-9498-19ea064bf517 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:37.223846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-064fd12c-814c-4a54-9498-19ea064bf517 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1677 microversion: 2.1 time: 0.293725 Oct 01 04:21:37.224765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 218/461] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:36 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1677 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:37.237180 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-3751b0de-7ead-4c83-b3d2-d50296582706 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:37.241004 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3751b0de-7ead-4c83-b3d2-d50296582706 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1266 microversion: 2.1 time: 0.288925 Oct 01 04:21:37.242108 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 244/462] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:36 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1266 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:21:37.246821 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-750eac99-848e-418d-aa5e-343a5e2fee9a req-45f54762-62a8-4d8d-81c2-163ec0f95edb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b31127e-af32-4116-90df-f27354ee55f4", "name": "network-vif-plugged", "status": "completed", "tag": "12264ff5-12ea-4894-9a40-7cdf57c7ecb0"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:21:37.247387 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-326db61b-21db-4d16-aedf-eaff026160c8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:37.248242 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-326db61b-21db-4d16-aedf-eaff026160c8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:37.254454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-326db61b-21db-4d16-aedf-eaff026160c8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:37.255066 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-326db61b-21db-4d16-aedf-eaff026160c8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:37.255601 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-326db61b-21db-4d16-aedf-eaff026160c8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:37.256397 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-326db61b-21db-4d16-aedf-eaff026160c8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:37.257060 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-326db61b-21db-4d16-aedf-eaff026160c8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:37.257567 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-326db61b-21db-4d16-aedf-eaff026160c8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:37.260372 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-750eac99-848e-418d-aa5e-343a5e2fee9a req-45f54762-62a8-4d8d-81c2-163ec0f95edb service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:37.260856 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-750eac99-848e-418d-aa5e-343a5e2fee9a req-45f54762-62a8-4d8d-81c2-163ec0f95edb service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:37.261313 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-750eac99-848e-418d-aa5e-343a5e2fee9a req-45f54762-62a8-4d8d-81c2-163ec0f95edb service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:37.280047 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-750eac99-848e-418d-aa5e-343a5e2fee9a req-45f54762-62a8-4d8d-81c2-163ec0f95edb service nova] Creating event network-vif-plugged:12264ff5-12ea-4894-9a40-7cdf57c7ecb0 for instance 1b31127e-af32-4116-90df-f27354ee55f4 on hv-cinder-86004 Oct 01 04:21:37.291822 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-750eac99-848e-418d-aa5e-343a5e2fee9a req-45f54762-62a8-4d8d-81c2-163ec0f95edb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048016 Oct 01 04:21:37.293103 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 245/463] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:21:37.407587 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-326db61b-21db-4d16-aedf-eaff026160c8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:37.416691 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-326db61b-21db-4d16-aedf-eaff026160c8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:37.418218 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-326db61b-21db-4d16-aedf-eaff026160c8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:37.419449 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-326db61b-21db-4d16-aedf-eaff026160c8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.180409 Oct 01 04:21:37.420407 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 219/464] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:37 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:21:37.860949 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-3be79307-836f-4bcd-a42e-e42df9399c36 req-ea3312fd-df39-4417-843d-0fb03f288042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b9af495-cd51-4492-af9f-d43ba016007b", "tag": "a9fcf58b-9af0-47d5-9218-efddc535ddda"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:21:37.875290 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3be79307-836f-4bcd-a42e-e42df9399c36 req-ea3312fd-df39-4417-843d-0fb03f288042 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:37.875889 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3be79307-836f-4bcd-a42e-e42df9399c36 req-ea3312fd-df39-4417-843d-0fb03f288042 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:37.876806 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3be79307-836f-4bcd-a42e-e42df9399c36 req-ea3312fd-df39-4417-843d-0fb03f288042 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:37.890640 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-3be79307-836f-4bcd-a42e-e42df9399c36 req-ea3312fd-df39-4417-843d-0fb03f288042 service nova] Creating event network-changed:a9fcf58b-9af0-47d5-9218-efddc535ddda for instance 0b9af495-cd51-4492-af9f-d43ba016007b on hv-cinder-86004 Oct 01 04:21:37.897575 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-3be79307-836f-4bcd-a42e-e42df9399c36 req-ea3312fd-df39-4417-843d-0fb03f288042 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041337 Oct 01 04:21:37.898746 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 246/465] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:21:38.253678 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2ef61f82-5aa7-4185-98b4-cd53159d55cc tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:38.254303 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2ef61f82-5aa7-4185-98b4-cd53159d55cc tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:38.261637 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ef61f82-5aa7-4185-98b4-cd53159d55cc tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:38.262481 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ef61f82-5aa7-4185-98b4-cd53159d55cc tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:38.263588 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ef61f82-5aa7-4185-98b4-cd53159d55cc tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:38.264652 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ef61f82-5aa7-4185-98b4-cd53159d55cc tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:38.264948 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-42e68f7b-94d9-436e-8ade-b4bd2abd9715 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:38.265403 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ef61f82-5aa7-4185-98b4-cd53159d55cc tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:38.265652 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-42e68f7b-94d9-436e-8ade-b4bd2abd9715 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:38.265791 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2ef61f82-5aa7-4185-98b4-cd53159d55cc tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:38.277846 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42e68f7b-94d9-436e-8ade-b4bd2abd9715 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:38.279198 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42e68f7b-94d9-436e-8ade-b4bd2abd9715 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:38.280873 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42e68f7b-94d9-436e-8ade-b4bd2abd9715 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:38.281934 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42e68f7b-94d9-436e-8ade-b4bd2abd9715 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:38.282950 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42e68f7b-94d9-436e-8ade-b4bd2abd9715 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:38.283645 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42e68f7b-94d9-436e-8ade-b4bd2abd9715 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:38.501768 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-2ef61f82-5aa7-4185-98b4-cd53159d55cc tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:38.515913 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2ef61f82-5aa7-4185-98b4-cd53159d55cc tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1677 microversion: 2.1 time: 0.266806 Oct 01 04:21:38.518057 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 220/466] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:38 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1677 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:38.525843 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d6213f53-d351-481e-8414-4267dc95a0af tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:38.529796 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-42e68f7b-94d9-436e-8ade-b4bd2abd9715 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:38.533863 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d6213f53-d351-481e-8414-4267dc95a0af tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:38.540274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6213f53-d351-481e-8414-4267dc95a0af tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:38.541116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6213f53-d351-481e-8414-4267dc95a0af tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:38.541708 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6213f53-d351-481e-8414-4267dc95a0af tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:38.542581 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6213f53-d351-481e-8414-4267dc95a0af tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:38.543039 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6213f53-d351-481e-8414-4267dc95a0af tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:38.543178 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-42e68f7b-94d9-436e-8ade-b4bd2abd9715 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1266 microversion: 2.1 time: 0.281605 Oct 01 04:21:38.543915 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 247/467] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:38 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1266 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:21:38.557613 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d6213f53-d351-481e-8414-4267dc95a0af tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:38.705763 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-d6213f53-d351-481e-8414-4267dc95a0af tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:38.720089 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-d6213f53-d351-481e-8414-4267dc95a0af tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:38.721609 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-d6213f53-d351-481e-8414-4267dc95a0af tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:38.722837 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d6213f53-d351-481e-8414-4267dc95a0af tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.203394 Oct 01 04:21:38.723464 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 221/468] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:38 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:21:39.047824 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d625f1c8-6fdb-4ffe-bd23-023e3a5f21f1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1556824329"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:21:39.048462 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d625f1c8-6fdb-4ffe-bd23-023e3a5f21f1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:39.055237 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d625f1c8-6fdb-4ffe-bd23-023e3a5f21f1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:39.055895 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d625f1c8-6fdb-4ffe-bd23-023e3a5f21f1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:39.056723 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d625f1c8-6fdb-4ffe-bd23-023e3a5f21f1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:39.057963 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d625f1c8-6fdb-4ffe-bd23-023e3a5f21f1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:39.058547 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d625f1c8-6fdb-4ffe-bd23-023e3a5f21f1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:39.059306 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d625f1c8-6fdb-4ffe-bd23-023e3a5f21f1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:39.224294 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.network.security_group_api [None req-d625f1c8-6fdb-4ffe-bd23-023e3a5f21f1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Adding security group 2ca7254b-ab3b-4660-8166-5acecb5f522b to port a9fcf58b-9af0-47d5-9218-efddc535ddda Oct 01 04:21:39.308214 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-9d776626-2ae9-4b9f-aed2-f36d05a6b38e req-2bdd2b03-8d8c-4b81-a1e0-5afce226a410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e14e3570-67e7-43d6-bcaf-6688168956b2", "name": "network-vif-plugged", "status": "completed", "tag": "28ed6420-e14b-48a2-a448-a8ab736b93af"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:21:39.319291 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9d776626-2ae9-4b9f-aed2-f36d05a6b38e req-2bdd2b03-8d8c-4b81-a1e0-5afce226a410 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:39.319758 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9d776626-2ae9-4b9f-aed2-f36d05a6b38e req-2bdd2b03-8d8c-4b81-a1e0-5afce226a410 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:39.320184 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9d776626-2ae9-4b9f-aed2-f36d05a6b38e req-2bdd2b03-8d8c-4b81-a1e0-5afce226a410 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:39.331546 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-9d776626-2ae9-4b9f-aed2-f36d05a6b38e req-2bdd2b03-8d8c-4b81-a1e0-5afce226a410 service nova] Creating event network-vif-plugged:28ed6420-e14b-48a2-a448-a8ab736b93af for instance e14e3570-67e7-43d6-bcaf-6688168956b2 on hv-cinder-86004 Oct 01 04:21:39.336513 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-9d776626-2ae9-4b9f-aed2-f36d05a6b38e req-2bdd2b03-8d8c-4b81-a1e0-5afce226a410 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031862 Oct 01 04:21:39.337196 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 222/469] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:21:39.540647 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7c9e365b-1595-4bc9-b299-84e342b66e24 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:39.541721 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7c9e365b-1595-4bc9-b299-84e342b66e24 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:39.549721 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c9e365b-1595-4bc9-b299-84e342b66e24 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:39.550217 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c9e365b-1595-4bc9-b299-84e342b66e24 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:39.550649 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c9e365b-1595-4bc9-b299-84e342b66e24 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:39.551505 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c9e365b-1595-4bc9-b299-84e342b66e24 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:39.552124 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c9e365b-1595-4bc9-b299-84e342b66e24 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:39.552545 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7c9e365b-1595-4bc9-b299-84e342b66e24 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:39.641133 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d625f1c8-6fdb-4ffe-bd23-023e3a5f21f1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "POST /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b/action" status: 202 len: 0 microversion: 2.1 time: 0.597507 Oct 01 04:21:39.642033 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 248/470] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 1 04:21:39 2022] POST /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b/action => generated 0 bytes in 599 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 04:21:39.646873 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e24137b1-acfc-4c35-b436-b666fac6d09b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:39.647674 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e24137b1-acfc-4c35-b436-b666fac6d09b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:39.654846 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e24137b1-acfc-4c35-b436-b666fac6d09b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:39.655505 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e24137b1-acfc-4c35-b436-b666fac6d09b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:39.656047 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e24137b1-acfc-4c35-b436-b666fac6d09b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:39.656883 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e24137b1-acfc-4c35-b436-b666fac6d09b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:39.657532 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e24137b1-acfc-4c35-b436-b666fac6d09b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:39.658088 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e24137b1-acfc-4c35-b436-b666fac6d09b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:39.853046 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-7c9e365b-1595-4bc9-b299-84e342b66e24 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:39.862667 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7c9e365b-1595-4bc9-b299-84e342b66e24 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1677 microversion: 2.1 time: 0.326261 Oct 01 04:21:39.864063 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 223/471] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:39 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1677 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:21:39.869604 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cb2f3f25-87ec-4bd0-9f7c-f9a65c40c1cd tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:39.870555 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cb2f3f25-87ec-4bd0-9f7c-f9a65c40c1cd tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:39.880947 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb2f3f25-87ec-4bd0-9f7c-f9a65c40c1cd tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:39.881767 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb2f3f25-87ec-4bd0-9f7c-f9a65c40c1cd tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:39.882947 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb2f3f25-87ec-4bd0-9f7c-f9a65c40c1cd tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:39.883960 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb2f3f25-87ec-4bd0-9f7c-f9a65c40c1cd tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:39.884623 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb2f3f25-87ec-4bd0-9f7c-f9a65c40c1cd tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:39.885283 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb2f3f25-87ec-4bd0-9f7c-f9a65c40c1cd tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:39.921331 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e24137b1-acfc-4c35-b436-b666fac6d09b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:39.933809 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e24137b1-acfc-4c35-b436-b666fac6d09b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1453 microversion: 2.1 time: 0.289386 Oct 01 04:21:39.935982 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 249/472] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:39 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1453 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:39.946017 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-8a01a664-02ac-4a26-997a-a34cc9b8b955 req-ae382910-3745-4f38-a5a2-34a32084d19e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b9af495-cd51-4492-af9f-d43ba016007b", "tag": "a9fcf58b-9af0-47d5-9218-efddc535ddda"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:21:39.975763 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8a01a664-02ac-4a26-997a-a34cc9b8b955 req-ae382910-3745-4f38-a5a2-34a32084d19e service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:39.976436 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8a01a664-02ac-4a26-997a-a34cc9b8b955 req-ae382910-3745-4f38-a5a2-34a32084d19e service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:39.977120 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8a01a664-02ac-4a26-997a-a34cc9b8b955 req-ae382910-3745-4f38-a5a2-34a32084d19e service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:39.991920 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-8a01a664-02ac-4a26-997a-a34cc9b8b955 req-ae382910-3745-4f38-a5a2-34a32084d19e service nova] Creating event network-changed:a9fcf58b-9af0-47d5-9218-efddc535ddda for instance 0b9af495-cd51-4492-af9f-d43ba016007b on hv-cinder-86004 Oct 01 04:21:39.999829 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-8a01a664-02ac-4a26-997a-a34cc9b8b955 req-ae382910-3745-4f38-a5a2-34a32084d19e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062295 Oct 01 04:21:40.001834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 250/473] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:21:40.007919 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d8b58d28-76a7-49f7-a89c-09630db911c2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:40.019900 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d8b58d28-76a7-49f7-a89c-09630db911c2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:40.031197 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8b58d28-76a7-49f7-a89c-09630db911c2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:40.032110 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8b58d28-76a7-49f7-a89c-09630db911c2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:40.033165 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8b58d28-76a7-49f7-a89c-09630db911c2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:40.035166 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8b58d28-76a7-49f7-a89c-09630db911c2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:40.035959 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8b58d28-76a7-49f7-a89c-09630db911c2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:40.036592 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8b58d28-76a7-49f7-a89c-09630db911c2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:40.151480 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-cb2f3f25-87ec-4bd0-9f7c-f9a65c40c1cd tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:40.164825 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cb2f3f25-87ec-4bd0-9f7c-f9a65c40c1cd tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1640 microversion: 2.1 time: 0.298472 Oct 01 04:21:40.166288 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 224/474] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:39 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1640 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:40.171618 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-619052fe-dc13-47e6-b3a8-53055a42e392 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:40.172220 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-619052fe-dc13-47e6-b3a8-53055a42e392 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:40.195335 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-619052fe-dc13-47e6-b3a8-53055a42e392 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:40.196478 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-619052fe-dc13-47e6-b3a8-53055a42e392 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:40.196946 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-619052fe-dc13-47e6-b3a8-53055a42e392 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:40.197680 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-619052fe-dc13-47e6-b3a8-53055a42e392 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:40.198138 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-619052fe-dc13-47e6-b3a8-53055a42e392 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:40.198560 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-619052fe-dc13-47e6-b3a8-53055a42e392 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:40.363192 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d8b58d28-76a7-49f7-a89c-09630db911c2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:40.372817 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d8b58d28-76a7-49f7-a89c-09630db911c2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:40.374707 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d8b58d28-76a7-49f7-a89c-09630db911c2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:40.376090 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d8b58d28-76a7-49f7-a89c-09630db911c2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.372311 Oct 01 04:21:40.376734 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 251/475] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:40 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:21:40.404705 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-619052fe-dc13-47e6-b3a8-53055a42e392 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:40.413025 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-619052fe-dc13-47e6-b3a8-53055a42e392 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1453 microversion: 2.1 time: 0.245643 Oct 01 04:21:40.413670 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 225/476] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:40 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1453 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:40.889990 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-42db939d-c616-4c3e-85f7-59fcbea52452 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:40.891251 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-42db939d-c616-4c3e-85f7-59fcbea52452 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:40.901521 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42db939d-c616-4c3e-85f7-59fcbea52452 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:40.902159 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42db939d-c616-4c3e-85f7-59fcbea52452 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:40.903197 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42db939d-c616-4c3e-85f7-59fcbea52452 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:40.903986 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42db939d-c616-4c3e-85f7-59fcbea52452 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:40.904453 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42db939d-c616-4c3e-85f7-59fcbea52452 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:40.904884 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-42db939d-c616-4c3e-85f7-59fcbea52452 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:41.167580 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-42db939d-c616-4c3e-85f7-59fcbea52452 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:41.178557 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-42db939d-c616-4c3e-85f7-59fcbea52452 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1677 microversion: 2.1 time: 0.292462 Oct 01 04:21:41.179356 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 252/477] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:40 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1677 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:41.402195 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-106f438b-6d3e-479c-bff0-e3113f251917 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:41.403112 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-106f438b-6d3e-479c-bff0-e3113f251917 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:41.410195 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-106f438b-6d3e-479c-bff0-e3113f251917 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:41.411406 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-106f438b-6d3e-479c-bff0-e3113f251917 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:41.411854 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-106f438b-6d3e-479c-bff0-e3113f251917 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:41.412590 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-106f438b-6d3e-479c-bff0-e3113f251917 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:41.413290 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-106f438b-6d3e-479c-bff0-e3113f251917 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:41.413730 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-106f438b-6d3e-479c-bff0-e3113f251917 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:41.702794 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-106f438b-6d3e-479c-bff0-e3113f251917 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:41.711623 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-106f438b-6d3e-479c-bff0-e3113f251917 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:41.713125 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-106f438b-6d3e-479c-bff0-e3113f251917 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:41.714296 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-106f438b-6d3e-479c-bff0-e3113f251917 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.316460 Oct 01 04:21:41.714860 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 226/478] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:41 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:21:42.204669 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-506a4681-b251-4ff7-9d5e-d7d1d2300df5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:42.205403 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-506a4681-b251-4ff7-9d5e-d7d1d2300df5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:42.211489 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-506a4681-b251-4ff7-9d5e-d7d1d2300df5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:42.211921 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-506a4681-b251-4ff7-9d5e-d7d1d2300df5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:42.212359 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-506a4681-b251-4ff7-9d5e-d7d1d2300df5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:42.213097 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-506a4681-b251-4ff7-9d5e-d7d1d2300df5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:42.213561 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-506a4681-b251-4ff7-9d5e-d7d1d2300df5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:42.213990 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-506a4681-b251-4ff7-9d5e-d7d1d2300df5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:42.421119 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-506a4681-b251-4ff7-9d5e-d7d1d2300df5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:42.429211 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-506a4681-b251-4ff7-9d5e-d7d1d2300df5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1677 microversion: 2.1 time: 0.229614 Oct 01 04:21:42.429814 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 253/479] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:42 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1677 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:42.604058 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-eb5b3cf0-d509-4e61-9b7b-0c49b294c169 req-7fa112fb-ad98-44da-b054-569d796c3b87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b31127e-af32-4116-90df-f27354ee55f4", "tag": "12264ff5-12ea-4894-9a40-7cdf57c7ecb0"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:21:42.615083 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-eb5b3cf0-d509-4e61-9b7b-0c49b294c169 req-7fa112fb-ad98-44da-b054-569d796c3b87 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:42.615572 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-eb5b3cf0-d509-4e61-9b7b-0c49b294c169 req-7fa112fb-ad98-44da-b054-569d796c3b87 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:42.616004 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-eb5b3cf0-d509-4e61-9b7b-0c49b294c169 req-7fa112fb-ad98-44da-b054-569d796c3b87 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:42.627461 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-eb5b3cf0-d509-4e61-9b7b-0c49b294c169 req-7fa112fb-ad98-44da-b054-569d796c3b87 service nova] Creating event network-changed:12264ff5-12ea-4894-9a40-7cdf57c7ecb0 for instance 1b31127e-af32-4116-90df-f27354ee55f4 on hv-cinder-86004 Oct 01 04:21:42.632315 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-eb5b3cf0-d509-4e61-9b7b-0c49b294c169 req-7fa112fb-ad98-44da-b054-569d796c3b87 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035679 Oct 01 04:21:42.632911 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 227/480] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:21:42.739594 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-daa39e74-60d2-4841-a2db-69694a4a65e6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:42.740243 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-daa39e74-60d2-4841-a2db-69694a4a65e6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:42.746198 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-daa39e74-60d2-4841-a2db-69694a4a65e6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:42.746675 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-daa39e74-60d2-4841-a2db-69694a4a65e6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:42.747156 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-daa39e74-60d2-4841-a2db-69694a4a65e6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:42.748228 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-daa39e74-60d2-4841-a2db-69694a4a65e6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:42.748720 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-daa39e74-60d2-4841-a2db-69694a4a65e6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:42.749155 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-daa39e74-60d2-4841-a2db-69694a4a65e6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:42.939261 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-daa39e74-60d2-4841-a2db-69694a4a65e6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:42.949683 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-daa39e74-60d2-4841-a2db-69694a4a65e6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:42.952729 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-daa39e74-60d2-4841-a2db-69694a4a65e6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:42.954527 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-daa39e74-60d2-4841-a2db-69694a4a65e6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1809 microversion: 2.20 time: 0.218646 Oct 01 04:21:42.955695 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 254/481] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:42 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1809 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:21:43.452916 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5c257a3e-9332-4119-87cc-31bb5ef1a3a4 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:43.453649 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5c257a3e-9332-4119-87cc-31bb5ef1a3a4 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:43.459853 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c257a3e-9332-4119-87cc-31bb5ef1a3a4 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:43.460343 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c257a3e-9332-4119-87cc-31bb5ef1a3a4 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:43.460781 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c257a3e-9332-4119-87cc-31bb5ef1a3a4 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:43.461509 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c257a3e-9332-4119-87cc-31bb5ef1a3a4 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:43.461969 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c257a3e-9332-4119-87cc-31bb5ef1a3a4 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:43.462394 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5c257a3e-9332-4119-87cc-31bb5ef1a3a4 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:43.603559 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-5c257a3e-9332-4119-87cc-31bb5ef1a3a4 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:43.612215 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5c257a3e-9332-4119-87cc-31bb5ef1a3a4 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1677 microversion: 2.1 time: 0.163583 Oct 01 04:21:43.612964 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 228/482] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:43 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:43.981151 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2b40e9b8-d950-4533-b184-14946a1e2745 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:43.982152 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2b40e9b8-d950-4533-b184-14946a1e2745 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:43.987849 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b40e9b8-d950-4533-b184-14946a1e2745 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:43.988283 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b40e9b8-d950-4533-b184-14946a1e2745 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:43.988715 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b40e9b8-d950-4533-b184-14946a1e2745 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:43.989429 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b40e9b8-d950-4533-b184-14946a1e2745 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:43.989880 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b40e9b8-d950-4533-b184-14946a1e2745 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:43.990304 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2b40e9b8-d950-4533-b184-14946a1e2745 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:44.008367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:21:44.117633 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2b40e9b8-d950-4533-b184-14946a1e2745 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:44.127003 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2b40e9b8-d950-4533-b184-14946a1e2745 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:44.128437 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2b40e9b8-d950-4533-b184-14946a1e2745 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:44.129638 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2b40e9b8-d950-4533-b184-14946a1e2745 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1796 microversion: 2.20 time: 0.152406 Oct 01 04:21:44.130193 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 255/483] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:21:43 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1796 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:21:44.635548 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b4ec8cfb-11f6-4ce5-a87d-5547124c0856 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:44.636173 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b4ec8cfb-11f6-4ce5-a87d-5547124c0856 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:44.642873 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4ec8cfb-11f6-4ce5-a87d-5547124c0856 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:44.643354 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4ec8cfb-11f6-4ce5-a87d-5547124c0856 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:44.643782 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4ec8cfb-11f6-4ce5-a87d-5547124c0856 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:44.644464 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4ec8cfb-11f6-4ce5-a87d-5547124c0856 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:44.644920 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4ec8cfb-11f6-4ce5-a87d-5547124c0856 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:44.645386 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b4ec8cfb-11f6-4ce5-a87d-5547124c0856 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:44.782028 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-b4ec8cfb-11f6-4ce5-a87d-5547124c0856 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:44.789663 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b4ec8cfb-11f6-4ce5-a87d-5547124c0856 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1677 microversion: 2.1 time: 0.158175 Oct 01 04:21:44.790217 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 229/484] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:44 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:45.813444 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6ffc5f64-d0f6-4fed-890c-5d3d5d4c820b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:45.814001 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6ffc5f64-d0f6-4fed-890c-5d3d5d4c820b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:45.819873 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ffc5f64-d0f6-4fed-890c-5d3d5d4c820b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:45.820353 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ffc5f64-d0f6-4fed-890c-5d3d5d4c820b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:45.820783 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ffc5f64-d0f6-4fed-890c-5d3d5d4c820b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:45.821486 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ffc5f64-d0f6-4fed-890c-5d3d5d4c820b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:45.821938 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ffc5f64-d0f6-4fed-890c-5d3d5d4c820b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:45.822352 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ffc5f64-d0f6-4fed-890c-5d3d5d4c820b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:45.947378 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-6ffc5f64-d0f6-4fed-890c-5d3d5d4c820b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:45.955577 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6ffc5f64-d0f6-4fed-890c-5d3d5d4c820b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1677 microversion: 2.1 time: 0.146120 Oct 01 04:21:45.956145 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 256/485] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:45 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:46.978721 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-35078056-8b2e-4c17-a24f-754233186188 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:46.979321 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-35078056-8b2e-4c17-a24f-754233186188 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:46.986451 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-35078056-8b2e-4c17-a24f-754233186188 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:46.986931 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-35078056-8b2e-4c17-a24f-754233186188 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:46.987370 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-35078056-8b2e-4c17-a24f-754233186188 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:46.988051 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-35078056-8b2e-4c17-a24f-754233186188 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:46.988503 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-35078056-8b2e-4c17-a24f-754233186188 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:46.988943 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-35078056-8b2e-4c17-a24f-754233186188 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:47.122307 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-35078056-8b2e-4c17-a24f-754233186188 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:47.129994 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-35078056-8b2e-4c17-a24f-754233186188 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1677 microversion: 2.1 time: 0.155055 Oct 01 04:21:47.130555 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 230/486] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:46 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:48.153898 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-609cc8b4-e6ae-413a-a556-e78e54213cb2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:48.154446 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-609cc8b4-e6ae-413a-a556-e78e54213cb2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:48.160437 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-609cc8b4-e6ae-413a-a556-e78e54213cb2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:48.160920 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-609cc8b4-e6ae-413a-a556-e78e54213cb2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:48.161386 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-609cc8b4-e6ae-413a-a556-e78e54213cb2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:48.162074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-609cc8b4-e6ae-413a-a556-e78e54213cb2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:48.162528 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-609cc8b4-e6ae-413a-a556-e78e54213cb2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:48.162950 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-609cc8b4-e6ae-413a-a556-e78e54213cb2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:48.291585 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-609cc8b4-e6ae-413a-a556-e78e54213cb2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:48.300020 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-609cc8b4-e6ae-413a-a556-e78e54213cb2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1677 microversion: 2.1 time: 0.150301 Oct 01 04:21:48.300581 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 257/487] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:48 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:49.323521 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-57c7ba2a-4079-496e-837d-5f84cc574408 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:49.324160 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-57c7ba2a-4079-496e-837d-5f84cc574408 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:49.331266 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57c7ba2a-4079-496e-837d-5f84cc574408 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:49.331745 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57c7ba2a-4079-496e-837d-5f84cc574408 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:49.332176 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57c7ba2a-4079-496e-837d-5f84cc574408 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:49.332858 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57c7ba2a-4079-496e-837d-5f84cc574408 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:49.333355 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57c7ba2a-4079-496e-837d-5f84cc574408 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:49.333773 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57c7ba2a-4079-496e-837d-5f84cc574408 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:49.463456 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-57c7ba2a-4079-496e-837d-5f84cc574408 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:49.471686 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-57c7ba2a-4079-496e-837d-5f84cc574408 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1677 microversion: 2.1 time: 0.151962 Oct 01 04:21:49.472243 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 231/488] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:49 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:50.495199 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7d36b95a-5abf-4198-bb42-808b73f9e9b1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:50.495799 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7d36b95a-5abf-4198-bb42-808b73f9e9b1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:50.498336 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=60 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:21:50.503561 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d36b95a-5abf-4198-bb42-808b73f9e9b1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:50.504046 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d36b95a-5abf-4198-bb42-808b73f9e9b1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:50.504500 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d36b95a-5abf-4198-bb42-808b73f9e9b1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:50.505199 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d36b95a-5abf-4198-bb42-808b73f9e9b1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:50.505651 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d36b95a-5abf-4198-bb42-808b73f9e9b1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:50.506068 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7d36b95a-5abf-4198-bb42-808b73f9e9b1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:50.631958 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7d36b95a-5abf-4198-bb42-808b73f9e9b1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:50.640398 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7d36b95a-5abf-4198-bb42-808b73f9e9b1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1677 microversion: 2.1 time: 0.149137 Oct 01 04:21:50.640979 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 258/489] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:50 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:51.664640 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cb937c6a-7159-44d7-b6cb-cd049d87e8ee tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:51.665264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cb937c6a-7159-44d7-b6cb-cd049d87e8ee tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:51.672289 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb937c6a-7159-44d7-b6cb-cd049d87e8ee tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:51.672796 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb937c6a-7159-44d7-b6cb-cd049d87e8ee tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:51.673265 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb937c6a-7159-44d7-b6cb-cd049d87e8ee tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:51.673947 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb937c6a-7159-44d7-b6cb-cd049d87e8ee tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:51.674487 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb937c6a-7159-44d7-b6cb-cd049d87e8ee tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:51.674908 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb937c6a-7159-44d7-b6cb-cd049d87e8ee tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:51.678838 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:21:51.803802 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-cb937c6a-7159-44d7-b6cb-cd049d87e8ee tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:51.811405 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cb937c6a-7159-44d7-b6cb-cd049d87e8ee tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1654 microversion: 2.1 time: 0.150576 Oct 01 04:21:51.811968 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 232/490] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:51 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1654 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:51.833447 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-20755b1a-6ae8-4bcd-98f6-4ed08bc7bf29 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:21:51.839368 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20755b1a-6ae8-4bcd-98f6-4ed08bc7bf29 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:51.839844 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20755b1a-6ae8-4bcd-98f6-4ed08bc7bf29 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:51.840269 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-20755b1a-6ae8-4bcd-98f6-4ed08bc7bf29 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:51.899660 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-20755b1a-6ae8-4bcd-98f6-4ed08bc7bf29 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Going to try to start instance {{(pid=120598) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 01 04:21:51.940113 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-20755b1a-6ae8-4bcd-98f6-4ed08bc7bf29 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "POST /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69/action" status: 202 len: 0 microversion: 2.1 time: 0.110406 Oct 01 04:21:51.940701 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 259/491] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 1 04:21:51 2022] POST /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 04:21:51.948626 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9c00a8a5-5f2d-4d09-bdd8-60f073135891 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:51.949277 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9c00a8a5-5f2d-4d09-bdd8-60f073135891 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:51.956216 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c00a8a5-5f2d-4d09-bdd8-60f073135891 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:51.956706 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c00a8a5-5f2d-4d09-bdd8-60f073135891 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:51.957191 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c00a8a5-5f2d-4d09-bdd8-60f073135891 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:51.961500 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c00a8a5-5f2d-4d09-bdd8-60f073135891 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:51.961500 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c00a8a5-5f2d-4d09-bdd8-60f073135891 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:51.961500 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9c00a8a5-5f2d-4d09-bdd8-60f073135891 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:52.096184 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-9c00a8a5-5f2d-4d09-bdd8-60f073135891 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:52.104571 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9c00a8a5-5f2d-4d09-bdd8-60f073135891 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1663 microversion: 2.1 time: 0.159150 Oct 01 04:21:52.108493 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 233/492] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:51 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1663 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:53.128079 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-25f497b8-1db6-4506-a1ce-901ff57f09ed tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:53.128772 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-25f497b8-1db6-4506-a1ce-901ff57f09ed tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:53.134975 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25f497b8-1db6-4506-a1ce-901ff57f09ed tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:53.135459 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25f497b8-1db6-4506-a1ce-901ff57f09ed tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:53.135889 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25f497b8-1db6-4506-a1ce-901ff57f09ed tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:53.136569 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25f497b8-1db6-4506-a1ce-901ff57f09ed tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:53.137048 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25f497b8-1db6-4506-a1ce-901ff57f09ed tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:53.137520 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25f497b8-1db6-4506-a1ce-901ff57f09ed tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:53.267789 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-25f497b8-1db6-4506-a1ce-901ff57f09ed tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:53.275598 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-25f497b8-1db6-4506-a1ce-901ff57f09ed tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1663 microversion: 2.1 time: 0.151850 Oct 01 04:21:53.276149 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 260/493] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:53 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1663 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:54.299179 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4425a5f1-bc1a-4c2b-843e-5911fe5eaeb3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:21:54.299823 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4425a5f1-bc1a-4c2b-843e-5911fe5eaeb3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:54.306473 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4425a5f1-bc1a-4c2b-843e-5911fe5eaeb3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:54.306963 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4425a5f1-bc1a-4c2b-843e-5911fe5eaeb3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:54.307405 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4425a5f1-bc1a-4c2b-843e-5911fe5eaeb3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:54.308100 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4425a5f1-bc1a-4c2b-843e-5911fe5eaeb3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:54.308585 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4425a5f1-bc1a-4c2b-843e-5911fe5eaeb3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:54.309039 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4425a5f1-bc1a-4c2b-843e-5911fe5eaeb3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:54.439384 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-4425a5f1-bc1a-4c2b-843e-5911fe5eaeb3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:21:54.446906 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4425a5f1-bc1a-4c2b-843e-5911fe5eaeb3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1667 microversion: 2.1 time: 0.151662 Oct 01 04:21:54.447483 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 234/494] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:21:54 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1667 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:21:56.850677 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-543a09b3-cc57-4ae3-b859-42f566e2cb9a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "102b99cd-166f-4162-8578-a607b1c2f69f"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:21:56.853045 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-543a09b3-cc57-4ae3-b859-42f566e2cb9a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:21:56.859767 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-543a09b3-cc57-4ae3-b859-42f566e2cb9a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:56.860257 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-543a09b3-cc57-4ae3-b859-42f566e2cb9a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:56.860693 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-543a09b3-cc57-4ae3-b859-42f566e2cb9a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:56.861421 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-543a09b3-cc57-4ae3-b859-42f566e2cb9a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:21:56.861879 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-543a09b3-cc57-4ae3-b859-42f566e2cb9a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:21:56.862300 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-543a09b3-cc57-4ae3-b859-42f566e2cb9a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:21:57.111784 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-543a09b3-cc57-4ae3-b859-42f566e2cb9a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "POST /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264873 Oct 01 04:21:57.112311 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 261/495] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 1 04:21:56 2022] POST /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:22:02.684088 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b1a2af59-b502-4e34-bd5e-864e23e354bb tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:22:02.686879 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b1a2af59-b502-4e34-bd5e-864e23e354bb tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:02.689365 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=52 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:02.694561 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1a2af59-b502-4e34-bd5e-864e23e354bb tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:02.695050 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1a2af59-b502-4e34-bd5e-864e23e354bb tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:02.695482 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1a2af59-b502-4e34-bd5e-864e23e354bb tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:02.696160 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1a2af59-b502-4e34-bd5e-864e23e354bb tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:02.696609 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1a2af59-b502-4e34-bd5e-864e23e354bb tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:02.697062 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b1a2af59-b502-4e34-bd5e-864e23e354bb tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:02.770838 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b1a2af59-b502-4e34-bd5e-864e23e354bb tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "POST /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b/action" status: 202 len: 0 microversion: 2.1 time: 0.090482 Oct 01 04:22:02.771476 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 235/496] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 1 04:22:02 2022] POST /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 04:22:02.782214 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0815a94d-2ef5-480b-8ee4-017867b33dff tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:02.782913 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0815a94d-2ef5-480b-8ee4-017867b33dff tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:02.789004 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0815a94d-2ef5-480b-8ee4-017867b33dff tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:02.789488 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0815a94d-2ef5-480b-8ee4-017867b33dff tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:02.789944 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0815a94d-2ef5-480b-8ee4-017867b33dff tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:02.790619 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0815a94d-2ef5-480b-8ee4-017867b33dff tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:02.791076 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0815a94d-2ef5-480b-8ee4-017867b33dff tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:02.791502 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0815a94d-2ef5-480b-8ee4-017867b33dff tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:02.938216 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0815a94d-2ef5-480b-8ee4-017867b33dff tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:02.946724 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0815a94d-2ef5-480b-8ee4-017867b33dff tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1751 microversion: 2.1 time: 0.170503 Oct 01 04:22:02.947343 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 262/497] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:02 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:03.972699 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-31634238-3cef-4c13-8923-b7f052f3a2af tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:03.973338 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-31634238-3cef-4c13-8923-b7f052f3a2af tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:03.979381 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31634238-3cef-4c13-8923-b7f052f3a2af tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:03.979865 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31634238-3cef-4c13-8923-b7f052f3a2af tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:03.980297 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31634238-3cef-4c13-8923-b7f052f3a2af tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:03.981003 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31634238-3cef-4c13-8923-b7f052f3a2af tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:03.981458 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31634238-3cef-4c13-8923-b7f052f3a2af tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:03.981901 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-31634238-3cef-4c13-8923-b7f052f3a2af tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:04.127193 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-31634238-3cef-4c13-8923-b7f052f3a2af tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:04.139783 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-31634238-3cef-4c13-8923-b7f052f3a2af tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1751 microversion: 2.1 time: 0.170370 Oct 01 04:22:04.140611 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 236/498] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:03 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:04.656790 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7adb7d8d-911f-4c40-a802-81cc8b73aab1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:22:04.659142 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7adb7d8d-911f-4c40-a802-81cc8b73aab1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:04.665559 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7adb7d8d-911f-4c40-a802-81cc8b73aab1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:04.666058 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7adb7d8d-911f-4c40-a802-81cc8b73aab1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:04.666497 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7adb7d8d-911f-4c40-a802-81cc8b73aab1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:04.667195 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7adb7d8d-911f-4c40-a802-81cc8b73aab1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:04.667655 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7adb7d8d-911f-4c40-a802-81cc8b73aab1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:04.668082 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7adb7d8d-911f-4c40-a802-81cc8b73aab1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:04.690151 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-7adb7d8d-911f-4c40-a802-81cc8b73aab1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lazy-loading 'flavor' on Instance uuid c6436bdc-2e17-43d4-a123-900e6269e551 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:22:04.811557 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7adb7d8d-911f-4c40-a802-81cc8b73aab1 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "POST /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551/action" status: 200 len: 32 microversion: 2.1 time: 0.159069 Oct 01 04:22:04.812425 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 263/499] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 1 04:22:04 2022] POST /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551/action => generated 32 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 04:22:04.822971 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fa3ec124-f03b-4566-9a56-0a0187e149cf tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:04.823589 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fa3ec124-f03b-4566-9a56-0a0187e149cf tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:04.830438 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa3ec124-f03b-4566-9a56-0a0187e149cf tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:04.831029 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa3ec124-f03b-4566-9a56-0a0187e149cf tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:04.831475 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa3ec124-f03b-4566-9a56-0a0187e149cf tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:04.832367 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa3ec124-f03b-4566-9a56-0a0187e149cf tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:04.832912 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa3ec124-f03b-4566-9a56-0a0187e149cf tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:04.833691 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa3ec124-f03b-4566-9a56-0a0187e149cf tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:04.981166 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-fa3ec124-f03b-4566-9a56-0a0187e149cf tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:04.989231 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fa3ec124-f03b-4566-9a56-0a0187e149cf tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1736 microversion: 2.1 time: 0.171098 Oct 01 04:22:04.990377 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 237/500] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:04 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:05.164259 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-69c5a528-ddeb-49d3-af7c-0dc2a3627762 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:05.164976 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-69c5a528-ddeb-49d3-af7c-0dc2a3627762 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:05.171173 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69c5a528-ddeb-49d3-af7c-0dc2a3627762 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:05.171662 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69c5a528-ddeb-49d3-af7c-0dc2a3627762 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:05.172098 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69c5a528-ddeb-49d3-af7c-0dc2a3627762 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:05.172800 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69c5a528-ddeb-49d3-af7c-0dc2a3627762 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:05.173295 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69c5a528-ddeb-49d3-af7c-0dc2a3627762 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:05.173701 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-69c5a528-ddeb-49d3-af7c-0dc2a3627762 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:05.320654 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-69c5a528-ddeb-49d3-af7c-0dc2a3627762 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:05.329369 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-69c5a528-ddeb-49d3-af7c-0dc2a3627762 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1756 microversion: 2.1 time: 0.169393 Oct 01 04:22:05.329944 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 264/501] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:05 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:06.013091 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7f24aa41-4a0f-466d-840d-1c43e0788729 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:06.013729 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7f24aa41-4a0f-466d-840d-1c43e0788729 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:06.021165 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f24aa41-4a0f-466d-840d-1c43e0788729 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:06.021647 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f24aa41-4a0f-466d-840d-1c43e0788729 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:06.022076 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f24aa41-4a0f-466d-840d-1c43e0788729 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:06.022764 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f24aa41-4a0f-466d-840d-1c43e0788729 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:06.023483 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f24aa41-4a0f-466d-840d-1c43e0788729 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:06.023905 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7f24aa41-4a0f-466d-840d-1c43e0788729 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:06.154448 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-7f24aa41-4a0f-466d-840d-1c43e0788729 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:06.163313 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7f24aa41-4a0f-466d-840d-1c43e0788729 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1736 microversion: 2.1 time: 0.154052 Oct 01 04:22:06.163870 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 238/502] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:06 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:06.352795 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c0581e79-0dee-48c1-a585-b7da88454083 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:06.353388 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c0581e79-0dee-48c1-a585-b7da88454083 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:06.359907 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0581e79-0dee-48c1-a585-b7da88454083 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:06.360395 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0581e79-0dee-48c1-a585-b7da88454083 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:06.360834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0581e79-0dee-48c1-a585-b7da88454083 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:06.361573 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0581e79-0dee-48c1-a585-b7da88454083 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:06.362025 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0581e79-0dee-48c1-a585-b7da88454083 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:06.362454 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c0581e79-0dee-48c1-a585-b7da88454083 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:06.501904 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c0581e79-0dee-48c1-a585-b7da88454083 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:06.510019 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c0581e79-0dee-48c1-a585-b7da88454083 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1756 microversion: 2.1 time: 0.161101 Oct 01 04:22:06.510598 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 265/503] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:06 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:07.186019 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a4c2addd-22eb-4dfd-9f52-92fc67323ea6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:07.186668 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a4c2addd-22eb-4dfd-9f52-92fc67323ea6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:07.193175 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4c2addd-22eb-4dfd-9f52-92fc67323ea6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:07.193662 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4c2addd-22eb-4dfd-9f52-92fc67323ea6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:07.194116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4c2addd-22eb-4dfd-9f52-92fc67323ea6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:07.194804 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4c2addd-22eb-4dfd-9f52-92fc67323ea6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:07.195256 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4c2addd-22eb-4dfd-9f52-92fc67323ea6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:07.195673 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4c2addd-22eb-4dfd-9f52-92fc67323ea6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:07.323779 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-a4c2addd-22eb-4dfd-9f52-92fc67323ea6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:07.331911 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a4c2addd-22eb-4dfd-9f52-92fc67323ea6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1736 microversion: 2.1 time: 0.149755 Oct 01 04:22:07.332473 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 239/504] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:07 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:07.534229 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e70230dc-af92-483a-aca8-0dbb2552a143 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:07.534837 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e70230dc-af92-483a-aca8-0dbb2552a143 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:07.541194 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e70230dc-af92-483a-aca8-0dbb2552a143 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:07.541669 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e70230dc-af92-483a-aca8-0dbb2552a143 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:07.542099 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e70230dc-af92-483a-aca8-0dbb2552a143 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:07.542790 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e70230dc-af92-483a-aca8-0dbb2552a143 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:07.543240 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e70230dc-af92-483a-aca8-0dbb2552a143 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:07.543660 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e70230dc-af92-483a-aca8-0dbb2552a143 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:07.685248 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e70230dc-af92-483a-aca8-0dbb2552a143 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:07.693284 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e70230dc-af92-483a-aca8-0dbb2552a143 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1756 microversion: 2.1 time: 0.162972 Oct 01 04:22:07.693871 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 266/505] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:07 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:08.355787 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-915bdb6e-eabe-473f-bb6d-443ee08e963d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:08.356395 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-915bdb6e-eabe-473f-bb6d-443ee08e963d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:08.363396 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-915bdb6e-eabe-473f-bb6d-443ee08e963d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:08.363821 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-915bdb6e-eabe-473f-bb6d-443ee08e963d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:08.364256 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-915bdb6e-eabe-473f-bb6d-443ee08e963d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:08.364961 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-915bdb6e-eabe-473f-bb6d-443ee08e963d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:08.365421 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-915bdb6e-eabe-473f-bb6d-443ee08e963d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:08.365846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-915bdb6e-eabe-473f-bb6d-443ee08e963d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:08.494263 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-915bdb6e-eabe-473f-bb6d-443ee08e963d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:08.503284 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-915bdb6e-eabe-473f-bb6d-443ee08e963d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1736 microversion: 2.1 time: 0.151337 Oct 01 04:22:08.503848 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 240/506] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:08 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:08.716496 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1542e841-b982-4492-aba0-1b50add18189 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:08.717128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1542e841-b982-4492-aba0-1b50add18189 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:08.723995 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1542e841-b982-4492-aba0-1b50add18189 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:08.724468 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1542e841-b982-4492-aba0-1b50add18189 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:08.724892 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1542e841-b982-4492-aba0-1b50add18189 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:08.725594 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1542e841-b982-4492-aba0-1b50add18189 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:08.726043 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1542e841-b982-4492-aba0-1b50add18189 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:08.726462 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1542e841-b982-4492-aba0-1b50add18189 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:08.870502 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1542e841-b982-4492-aba0-1b50add18189 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:08.874152 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:08.879668 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1542e841-b982-4492-aba0-1b50add18189 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1756 microversion: 2.1 time: 0.166995 Oct 01 04:22:08.880227 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 267/507] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:08 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:09.526804 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-09c033ef-878d-455d-8827-09c018c82963 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:09.527418 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-09c033ef-878d-455d-8827-09c018c82963 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:09.534199 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09c033ef-878d-455d-8827-09c018c82963 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:09.534687 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09c033ef-878d-455d-8827-09c018c82963 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:09.535128 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09c033ef-878d-455d-8827-09c018c82963 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:09.535816 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09c033ef-878d-455d-8827-09c018c82963 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:09.536272 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09c033ef-878d-455d-8827-09c018c82963 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:09.536695 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-09c033ef-878d-455d-8827-09c018c82963 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:09.665093 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-09c033ef-878d-455d-8827-09c018c82963 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:09.673396 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-09c033ef-878d-455d-8827-09c018c82963 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1736 microversion: 2.1 time: 0.150734 Oct 01 04:22:09.673956 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 241/508] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:09 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:22:09.903919 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-889ba92e-0451-405e-b428-6cc4f94f1215 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:09.904476 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-889ba92e-0451-405e-b428-6cc4f94f1215 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:09.912183 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-889ba92e-0451-405e-b428-6cc4f94f1215 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:09.912671 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-889ba92e-0451-405e-b428-6cc4f94f1215 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:09.913162 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-889ba92e-0451-405e-b428-6cc4f94f1215 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:09.913848 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-889ba92e-0451-405e-b428-6cc4f94f1215 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:09.914330 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-889ba92e-0451-405e-b428-6cc4f94f1215 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:09.914750 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-889ba92e-0451-405e-b428-6cc4f94f1215 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:10.057635 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-889ba92e-0451-405e-b428-6cc4f94f1215 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:10.066774 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-889ba92e-0451-405e-b428-6cc4f94f1215 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1756 microversion: 2.1 time: 0.167519 Oct 01 04:22:10.067340 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 268/509] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:09 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:10.696578 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e653b6ca-57d6-4883-a73d-38ae1e45980a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:10.697221 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e653b6ca-57d6-4883-a73d-38ae1e45980a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:10.704150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e653b6ca-57d6-4883-a73d-38ae1e45980a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:10.704623 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e653b6ca-57d6-4883-a73d-38ae1e45980a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:10.705084 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e653b6ca-57d6-4883-a73d-38ae1e45980a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:10.705798 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e653b6ca-57d6-4883-a73d-38ae1e45980a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:10.706250 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e653b6ca-57d6-4883-a73d-38ae1e45980a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:10.706695 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e653b6ca-57d6-4883-a73d-38ae1e45980a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:10.838339 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-e653b6ca-57d6-4883-a73d-38ae1e45980a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:10.847747 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e653b6ca-57d6-4883-a73d-38ae1e45980a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1736 microversion: 2.1 time: 0.154835 Oct 01 04:22:10.848315 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 242/510] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:10 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:11.089669 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-89a62848-0d5c-4a02-8ac6-19c4cceb4565 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:11.090197 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-89a62848-0d5c-4a02-8ac6-19c4cceb4565 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:11.097640 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89a62848-0d5c-4a02-8ac6-19c4cceb4565 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:11.098125 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89a62848-0d5c-4a02-8ac6-19c4cceb4565 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:11.098560 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89a62848-0d5c-4a02-8ac6-19c4cceb4565 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:11.099244 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89a62848-0d5c-4a02-8ac6-19c4cceb4565 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:11.099698 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89a62848-0d5c-4a02-8ac6-19c4cceb4565 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:11.100119 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-89a62848-0d5c-4a02-8ac6-19c4cceb4565 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:11.237915 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-89a62848-0d5c-4a02-8ac6-19c4cceb4565 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:11.247112 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-89a62848-0d5c-4a02-8ac6-19c4cceb4565 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1756 microversion: 2.1 time: 0.161356 Oct 01 04:22:11.248070 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 269/511] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:11 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:11.871262 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-285457ff-e3ee-4a76-b212-30974b2acb5e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:11.871876 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-285457ff-e3ee-4a76-b212-30974b2acb5e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:11.878862 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-285457ff-e3ee-4a76-b212-30974b2acb5e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:11.879338 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-285457ff-e3ee-4a76-b212-30974b2acb5e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:11.879805 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-285457ff-e3ee-4a76-b212-30974b2acb5e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:11.880500 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-285457ff-e3ee-4a76-b212-30974b2acb5e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:11.880985 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-285457ff-e3ee-4a76-b212-30974b2acb5e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:11.881413 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-285457ff-e3ee-4a76-b212-30974b2acb5e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:12.009902 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-285457ff-e3ee-4a76-b212-30974b2acb5e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:12.018600 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-285457ff-e3ee-4a76-b212-30974b2acb5e tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1736 microversion: 2.1 time: 0.151185 Oct 01 04:22:12.019166 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 243/512] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:11 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:12.270656 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8311b009-8c46-457c-8ea8-24b3290f9487 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:12.271264 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-8311b009-8c46-457c-8ea8-24b3290f9487 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:12.277846 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8311b009-8c46-457c-8ea8-24b3290f9487 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:12.278323 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8311b009-8c46-457c-8ea8-24b3290f9487 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:12.278751 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8311b009-8c46-457c-8ea8-24b3290f9487 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:12.279456 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8311b009-8c46-457c-8ea8-24b3290f9487 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:12.279916 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8311b009-8c46-457c-8ea8-24b3290f9487 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:12.280331 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-8311b009-8c46-457c-8ea8-24b3290f9487 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:12.418738 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-8311b009-8c46-457c-8ea8-24b3290f9487 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:12.427230 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8311b009-8c46-457c-8ea8-24b3290f9487 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1756 microversion: 2.1 time: 0.160358 Oct 01 04:22:12.427772 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 270/513] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:12 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:13.042181 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-945b1220-d187-4924-bd67-54453686bf8d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:13.042938 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-945b1220-d187-4924-bd67-54453686bf8d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:13.049828 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-945b1220-d187-4924-bd67-54453686bf8d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:13.050314 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-945b1220-d187-4924-bd67-54453686bf8d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:13.050744 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-945b1220-d187-4924-bd67-54453686bf8d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:13.051493 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-945b1220-d187-4924-bd67-54453686bf8d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:13.052068 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-945b1220-d187-4924-bd67-54453686bf8d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:13.052620 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-945b1220-d187-4924-bd67-54453686bf8d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:13.181577 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-945b1220-d187-4924-bd67-54453686bf8d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:13.190188 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-945b1220-d187-4924-bd67-54453686bf8d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1736 microversion: 2.1 time: 0.152005 Oct 01 04:22:13.190761 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 244/514] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:13 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:13.450019 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6b7886ae-3197-496b-8cbb-05fe33162d58 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:13.450665 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6b7886ae-3197-496b-8cbb-05fe33162d58 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:13.457949 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b7886ae-3197-496b-8cbb-05fe33162d58 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:13.458459 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b7886ae-3197-496b-8cbb-05fe33162d58 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:13.458890 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b7886ae-3197-496b-8cbb-05fe33162d58 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:13.459598 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b7886ae-3197-496b-8cbb-05fe33162d58 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:13.460037 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b7886ae-3197-496b-8cbb-05fe33162d58 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:13.460458 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6b7886ae-3197-496b-8cbb-05fe33162d58 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:13.601989 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-6b7886ae-3197-496b-8cbb-05fe33162d58 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:13.610969 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6b7886ae-3197-496b-8cbb-05fe33162d58 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1756 microversion: 2.1 time: 0.164786 Oct 01 04:22:13.611542 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 271/515] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:13 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:14.214124 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5aa96d1f-2917-48e3-9b56-8ed10b29422a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:14.214741 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5aa96d1f-2917-48e3-9b56-8ed10b29422a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:14.221957 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5aa96d1f-2917-48e3-9b56-8ed10b29422a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:14.222471 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5aa96d1f-2917-48e3-9b56-8ed10b29422a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:14.222908 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5aa96d1f-2917-48e3-9b56-8ed10b29422a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:14.223605 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5aa96d1f-2917-48e3-9b56-8ed10b29422a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:14.224067 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5aa96d1f-2917-48e3-9b56-8ed10b29422a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:14.224496 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5aa96d1f-2917-48e3-9b56-8ed10b29422a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:14.355448 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-5aa96d1f-2917-48e3-9b56-8ed10b29422a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:14.363662 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5aa96d1f-2917-48e3-9b56-8ed10b29422a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1736 microversion: 2.1 time: 0.153286 Oct 01 04:22:14.364168 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 245/516] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:14 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:14.634894 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2ee75aea-5832-4316-a576-e01a287bf2c9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:14.635515 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2ee75aea-5832-4316-a576-e01a287bf2c9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:14.642197 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ee75aea-5832-4316-a576-e01a287bf2c9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:14.642684 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ee75aea-5832-4316-a576-e01a287bf2c9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:14.643121 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ee75aea-5832-4316-a576-e01a287bf2c9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:14.643820 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ee75aea-5832-4316-a576-e01a287bf2c9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:14.644278 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ee75aea-5832-4316-a576-e01a287bf2c9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:14.644709 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2ee75aea-5832-4316-a576-e01a287bf2c9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:14.786137 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2ee75aea-5832-4316-a576-e01a287bf2c9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:14.794331 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2ee75aea-5832-4316-a576-e01a287bf2c9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1756 microversion: 2.1 time: 0.163243 Oct 01 04:22:14.794894 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 272/517] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:14 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:15.386587 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-26e264e4-46dd-4f6b-b953-77b9c1803c20 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:15.387146 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-26e264e4-46dd-4f6b-b953-77b9c1803c20 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:15.393583 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26e264e4-46dd-4f6b-b953-77b9c1803c20 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:15.394068 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26e264e4-46dd-4f6b-b953-77b9c1803c20 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:15.394517 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26e264e4-46dd-4f6b-b953-77b9c1803c20 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:15.395229 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26e264e4-46dd-4f6b-b953-77b9c1803c20 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:15.395678 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26e264e4-46dd-4f6b-b953-77b9c1803c20 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:15.396102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-26e264e4-46dd-4f6b-b953-77b9c1803c20 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:15.528291 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-26e264e4-46dd-4f6b-b953-77b9c1803c20 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:15.537586 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-26e264e4-46dd-4f6b-b953-77b9c1803c20 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1736 microversion: 2.1 time: 0.154736 Oct 01 04:22:15.538153 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 246/518] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:15 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:15.817738 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4a8cf7b0-365c-474b-a2d7-726ec4203059 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:15.818351 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4a8cf7b0-365c-474b-a2d7-726ec4203059 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:15.824724 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a8cf7b0-365c-474b-a2d7-726ec4203059 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:15.825237 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a8cf7b0-365c-474b-a2d7-726ec4203059 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:15.825671 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a8cf7b0-365c-474b-a2d7-726ec4203059 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:15.826361 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a8cf7b0-365c-474b-a2d7-726ec4203059 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:15.826847 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a8cf7b0-365c-474b-a2d7-726ec4203059 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:15.827269 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4a8cf7b0-365c-474b-a2d7-726ec4203059 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:15.969492 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-4a8cf7b0-365c-474b-a2d7-726ec4203059 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:15.977519 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4a8cf7b0-365c-474b-a2d7-726ec4203059 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1759 microversion: 2.1 time: 0.163548 Oct 01 04:22:15.978072 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 273/519] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:15 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:16.561954 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c43aeb28-e8ba-4311-9af9-4597541b3f3f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:16.563148 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c43aeb28-e8ba-4311-9af9-4597541b3f3f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:16.569500 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c43aeb28-e8ba-4311-9af9-4597541b3f3f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:16.569981 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c43aeb28-e8ba-4311-9af9-4597541b3f3f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:16.570414 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c43aeb28-e8ba-4311-9af9-4597541b3f3f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:16.571100 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c43aeb28-e8ba-4311-9af9-4597541b3f3f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:16.571552 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c43aeb28-e8ba-4311-9af9-4597541b3f3f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:16.571969 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c43aeb28-e8ba-4311-9af9-4597541b3f3f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:16.699454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c43aeb28-e8ba-4311-9af9-4597541b3f3f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:16.701804 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:16.709335 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c43aeb28-e8ba-4311-9af9-4597541b3f3f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1736 microversion: 2.1 time: 0.151146 Oct 01 04:22:16.709906 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 247/520] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:16 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:17.732432 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-303466db-f7eb-4a95-b4c2-89a9ee681f10 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:17.733084 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-303466db-f7eb-4a95-b4c2-89a9ee681f10 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:17.739637 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-303466db-f7eb-4a95-b4c2-89a9ee681f10 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:17.740121 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-303466db-f7eb-4a95-b4c2-89a9ee681f10 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:17.740556 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-303466db-f7eb-4a95-b4c2-89a9ee681f10 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:17.741324 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-303466db-f7eb-4a95-b4c2-89a9ee681f10 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:17.741785 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-303466db-f7eb-4a95-b4c2-89a9ee681f10 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:17.742212 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-303466db-f7eb-4a95-b4c2-89a9ee681f10 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:17.872787 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-303466db-f7eb-4a95-b4c2-89a9ee681f10 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:17.881625 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-303466db-f7eb-4a95-b4c2-89a9ee681f10 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1736 microversion: 2.1 time: 0.153027 Oct 01 04:22:17.882196 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 274/521] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:17 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:18.905170 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-605895d5-8a70-428b-b1b1-7ccaeca90c03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:18.905700 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-605895d5-8a70-428b-b1b1-7ccaeca90c03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:18.914287 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-605895d5-8a70-428b-b1b1-7ccaeca90c03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:18.914766 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-605895d5-8a70-428b-b1b1-7ccaeca90c03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:18.915195 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-605895d5-8a70-428b-b1b1-7ccaeca90c03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:18.915967 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-605895d5-8a70-428b-b1b1-7ccaeca90c03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:18.916419 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-605895d5-8a70-428b-b1b1-7ccaeca90c03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:18.916839 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-605895d5-8a70-428b-b1b1-7ccaeca90c03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:19.044816 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-605895d5-8a70-428b-b1b1-7ccaeca90c03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:19.053035 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-605895d5-8a70-428b-b1b1-7ccaeca90c03 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1736 microversion: 2.1 time: 0.151925 Oct 01 04:22:19.053597 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 248/522] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:18 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:22:20.075613 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-64e7a043-0358-48ad-854c-b49fefe783bc tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:20.076226 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-64e7a043-0358-48ad-854c-b49fefe783bc tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:20.083340 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64e7a043-0358-48ad-854c-b49fefe783bc tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:20.083822 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64e7a043-0358-48ad-854c-b49fefe783bc tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:20.084259 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64e7a043-0358-48ad-854c-b49fefe783bc tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:20.084971 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64e7a043-0358-48ad-854c-b49fefe783bc tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:20.085435 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64e7a043-0358-48ad-854c-b49fefe783bc tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:20.085859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64e7a043-0358-48ad-854c-b49fefe783bc tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:20.212724 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-64e7a043-0358-48ad-854c-b49fefe783bc tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:20.221068 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-64e7a043-0358-48ad-854c-b49fefe783bc tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1736 microversion: 2.1 time: 0.149321 Oct 01 04:22:20.221638 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 275/523] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:20 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:21.243882 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b80c112c-fd4a-4b15-9227-e3c40d244949 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:21.244496 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b80c112c-fd4a-4b15-9227-e3c40d244949 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:21.251394 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b80c112c-fd4a-4b15-9227-e3c40d244949 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:21.251880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b80c112c-fd4a-4b15-9227-e3c40d244949 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:21.252316 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b80c112c-fd4a-4b15-9227-e3c40d244949 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:21.253037 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b80c112c-fd4a-4b15-9227-e3c40d244949 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:21.253504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b80c112c-fd4a-4b15-9227-e3c40d244949 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:21.253926 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b80c112c-fd4a-4b15-9227-e3c40d244949 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:21.391947 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-b80c112c-fd4a-4b15-9227-e3c40d244949 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:21.400428 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b80c112c-fd4a-4b15-9227-e3c40d244949 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1736 microversion: 2.1 time: 0.160380 Oct 01 04:22:21.401121 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 249/524] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:21 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:22.423879 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-64d2d581-56e8-4062-b682-6cdc415c05ba tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:22.424487 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-64d2d581-56e8-4062-b682-6cdc415c05ba tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:22.426823 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=36 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:22.432056 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64d2d581-56e8-4062-b682-6cdc415c05ba tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:22.432534 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64d2d581-56e8-4062-b682-6cdc415c05ba tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:22.432999 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64d2d581-56e8-4062-b682-6cdc415c05ba tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:22.433692 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64d2d581-56e8-4062-b682-6cdc415c05ba tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:22.434147 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64d2d581-56e8-4062-b682-6cdc415c05ba tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:22.434570 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64d2d581-56e8-4062-b682-6cdc415c05ba tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:22.565633 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-64d2d581-56e8-4062-b682-6cdc415c05ba tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:22.573869 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-64d2d581-56e8-4062-b682-6cdc415c05ba tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1736 microversion: 2.1 time: 0.153729 Oct 01 04:22:22.574430 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 276/525] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:22 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:23.598051 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-baa2f307-9eb8-446d-9f03-0ab70573c87c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:23.598642 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-baa2f307-9eb8-446d-9f03-0ab70573c87c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:23.605136 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-baa2f307-9eb8-446d-9f03-0ab70573c87c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:23.605615 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-baa2f307-9eb8-446d-9f03-0ab70573c87c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:23.606048 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-baa2f307-9eb8-446d-9f03-0ab70573c87c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:23.606735 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-baa2f307-9eb8-446d-9f03-0ab70573c87c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:23.607189 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-baa2f307-9eb8-446d-9f03-0ab70573c87c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:23.607609 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-baa2f307-9eb8-446d-9f03-0ab70573c87c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:23.921236 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-baa2f307-9eb8-446d-9f03-0ab70573c87c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:23.929367 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-baa2f307-9eb8-446d-9f03-0ab70573c87c tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1736 microversion: 2.1 time: 0.335101 Oct 01 04:22:23.929931 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 250/526] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:23 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1736 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:24.451836 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-99c5126b-dc31-47c5-89e2-81a4fafc8498 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:24.452365 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-99c5126b-dc31-47c5-89e2-81a4fafc8498 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:24.458881 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99c5126b-dc31-47c5-89e2-81a4fafc8498 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:24.459369 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99c5126b-dc31-47c5-89e2-81a4fafc8498 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:24.459803 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99c5126b-dc31-47c5-89e2-81a4fafc8498 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:24.460487 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99c5126b-dc31-47c5-89e2-81a4fafc8498 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:24.460965 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99c5126b-dc31-47c5-89e2-81a4fafc8498 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:24.461396 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-99c5126b-dc31-47c5-89e2-81a4fafc8498 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:24.493054 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-99c5126b-dc31-47c5-89e2-81a4fafc8498 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2/os-volume_attachments/d290f931-1e7e-4464-bb8d-ba6f5bebca18" status: 200 len: 194 microversion: 2.20 time: 0.045232 Oct 01 04:22:24.493626 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 277/527] 10.222.0.26 () {60 vars in 1454 bytes} [Sat Oct 1 04:22:24 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2/os-volume_attachments/d290f931-1e7e-4464-bb8d-ba6f5bebca18 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 04:22:24.562872 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-343ae362-7c48-4582-a247-468ad97544c8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:24.563377 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-343ae362-7c48-4582-a247-468ad97544c8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:24.569310 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-343ae362-7c48-4582-a247-468ad97544c8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:24.569798 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-343ae362-7c48-4582-a247-468ad97544c8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:24.570237 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-343ae362-7c48-4582-a247-468ad97544c8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:24.570927 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-343ae362-7c48-4582-a247-468ad97544c8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:24.571389 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-343ae362-7c48-4582-a247-468ad97544c8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:24.571816 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-343ae362-7c48-4582-a247-468ad97544c8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:24.650625 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-343ae362-7c48-4582-a247-468ad97544c8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lazy-loading 'services' on Instance uuid e14e3570-67e7-43d6-bcaf-6688168956b2 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:22:24.723380 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-343ae362-7c48-4582-a247-468ad97544c8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2/os-volume_attachments/d290f931-1e7e-4464-bb8d-ba6f5bebca18" status: 202 len: 0 microversion: 2.20 time: 0.164846 Oct 01 04:22:24.723984 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 251/528] 10.222.0.26 () {60 vars in 1457 bytes} [Sat Oct 1 04:22:24 2022] DELETE /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2/os-volume_attachments/d290f931-1e7e-4464-bb8d-ba6f5bebca18 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 01 04:22:24.732397 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-54b47e7c-432b-45ba-8181-99b80a045255 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:24.735376 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-54b47e7c-432b-45ba-8181-99b80a045255 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:24.741869 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54b47e7c-432b-45ba-8181-99b80a045255 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:24.742364 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54b47e7c-432b-45ba-8181-99b80a045255 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:24.742836 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54b47e7c-432b-45ba-8181-99b80a045255 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:24.743579 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54b47e7c-432b-45ba-8181-99b80a045255 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:24.744164 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54b47e7c-432b-45ba-8181-99b80a045255 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:24.744593 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-54b47e7c-432b-45ba-8181-99b80a045255 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:24.775751 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-54b47e7c-432b-45ba-8181-99b80a045255 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047302 Oct 01 04:22:24.776363 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 278/529] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 1 04:22:24 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 04:22:24.952081 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4081a87c-8570-4e30-8897-8e1c0870eaaf tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:24.953459 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4081a87c-8570-4e30-8897-8e1c0870eaaf tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:24.959736 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4081a87c-8570-4e30-8897-8e1c0870eaaf tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:24.960163 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4081a87c-8570-4e30-8897-8e1c0870eaaf tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:24.960598 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4081a87c-8570-4e30-8897-8e1c0870eaaf tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:24.961313 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4081a87c-8570-4e30-8897-8e1c0870eaaf tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:24.961771 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4081a87c-8570-4e30-8897-8e1c0870eaaf tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:24.962193 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4081a87c-8570-4e30-8897-8e1c0870eaaf tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:25.088362 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-4081a87c-8570-4e30-8897-8e1c0870eaaf tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:25.097394 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4081a87c-8570-4e30-8897-8e1c0870eaaf tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1736 microversion: 2.1 time: 0.149472 Oct 01 04:22:25.097966 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 252/530] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:24 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:25.789124 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4c72b817-2c5c-4463-bf30-ae5d8449088c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:25.791220 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4c72b817-2c5c-4463-bf30-ae5d8449088c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:25.797645 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c72b817-2c5c-4463-bf30-ae5d8449088c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:25.798124 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c72b817-2c5c-4463-bf30-ae5d8449088c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:25.798560 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c72b817-2c5c-4463-bf30-ae5d8449088c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:25.799247 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c72b817-2c5c-4463-bf30-ae5d8449088c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:25.799703 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c72b817-2c5c-4463-bf30-ae5d8449088c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:25.800124 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c72b817-2c5c-4463-bf30-ae5d8449088c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:25.829333 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4c72b817-2c5c-4463-bf30-ae5d8449088c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044141 Oct 01 04:22:25.829934 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 279/531] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 1 04:22:25 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:25.899829 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-78f07070-a225-4e28-af82-041c5c85fd52 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:25.900328 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-78f07070-a225-4e28-af82-041c5c85fd52 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:25.906744 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78f07070-a225-4e28-af82-041c5c85fd52 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:25.907232 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78f07070-a225-4e28-af82-041c5c85fd52 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:25.907840 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78f07070-a225-4e28-af82-041c5c85fd52 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:25.908540 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78f07070-a225-4e28-af82-041c5c85fd52 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:25.909028 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78f07070-a225-4e28-af82-041c5c85fd52 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:25.909458 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78f07070-a225-4e28-af82-041c5c85fd52 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:25.935387 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-78f07070-a225-4e28-af82-041c5c85fd52 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 04:22:26.018606 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-78f07070-a225-4e28-af82-041c5c85fd52 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 204 len: 0 microversion: 2.20 time: 0.122661 Oct 01 04:22:26.019131 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 253/532] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 1 04:22:25 2022] DELETE /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 04:22:26.027568 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fe8f6f88-69ef-415d-b870-238b43f03197 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:26.028187 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fe8f6f88-69ef-415d-b870-238b43f03197 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:26.034113 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe8f6f88-69ef-415d-b870-238b43f03197 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:26.034599 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe8f6f88-69ef-415d-b870-238b43f03197 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:26.035035 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe8f6f88-69ef-415d-b870-238b43f03197 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:26.035727 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe8f6f88-69ef-415d-b870-238b43f03197 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:26.036188 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe8f6f88-69ef-415d-b870-238b43f03197 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:26.036618 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fe8f6f88-69ef-415d-b870-238b43f03197 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:26.120701 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6a9ad339-489c-404b-8262-bead88e6733f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:26.121506 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6a9ad339-489c-404b-8262-bead88e6733f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:26.127643 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a9ad339-489c-404b-8262-bead88e6733f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:26.128128 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a9ad339-489c-404b-8262-bead88e6733f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:26.128560 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a9ad339-489c-404b-8262-bead88e6733f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:26.129284 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a9ad339-489c-404b-8262-bead88e6733f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:26.129739 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a9ad339-489c-404b-8262-bead88e6733f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:26.130163 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6a9ad339-489c-404b-8262-bead88e6733f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:26.183603 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-fe8f6f88-69ef-415d-b870-238b43f03197 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:26.191892 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-fe8f6f88-69ef-415d-b870-238b43f03197 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:26.193388 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-fe8f6f88-69ef-415d-b870-238b43f03197 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:26.194567 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fe8f6f88-69ef-415d-b870-238b43f03197 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1724 microversion: 2.20 time: 0.170816 Oct 01 04:22:26.195116 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 280/533] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:22:26 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:22:26.270774 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-6a9ad339-489c-404b-8262-bead88e6733f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:26.279119 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6a9ad339-489c-404b-8262-bead88e6733f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1736 microversion: 2.1 time: 0.162700 Oct 01 04:22:26.279677 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 254/534] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:26 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:22:27.220995 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-18acca47-3886-46a5-b172-80f9cd18d182 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:27.221651 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-18acca47-3886-46a5-b172-80f9cd18d182 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:27.227569 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18acca47-3886-46a5-b172-80f9cd18d182 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:27.228051 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18acca47-3886-46a5-b172-80f9cd18d182 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:27.228521 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18acca47-3886-46a5-b172-80f9cd18d182 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:27.229246 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18acca47-3886-46a5-b172-80f9cd18d182 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:27.229708 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18acca47-3886-46a5-b172-80f9cd18d182 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:27.230129 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18acca47-3886-46a5-b172-80f9cd18d182 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:27.303017 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a86d4f21-7a3b-46f0-ba5b-4eb476707598 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:27.303563 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a86d4f21-7a3b-46f0-ba5b-4eb476707598 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:27.309946 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a86d4f21-7a3b-46f0-ba5b-4eb476707598 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:27.310462 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a86d4f21-7a3b-46f0-ba5b-4eb476707598 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:27.310932 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a86d4f21-7a3b-46f0-ba5b-4eb476707598 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:27.311651 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a86d4f21-7a3b-46f0-ba5b-4eb476707598 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:27.312362 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a86d4f21-7a3b-46f0-ba5b-4eb476707598 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:27.312552 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a86d4f21-7a3b-46f0-ba5b-4eb476707598 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:27.370617 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-18acca47-3886-46a5-b172-80f9cd18d182 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:27.379635 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-18acca47-3886-46a5-b172-80f9cd18d182 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:27.381344 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-18acca47-3886-46a5-b172-80f9cd18d182 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:27.382599 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-18acca47-3886-46a5-b172-80f9cd18d182 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1724 microversion: 2.20 time: 0.166400 Oct 01 04:22:27.383250 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 281/535] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:22:27 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:22:27.453510 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-a86d4f21-7a3b-46f0-ba5b-4eb476707598 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:27.461666 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a86d4f21-7a3b-46f0-ba5b-4eb476707598 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1736 microversion: 2.1 time: 0.162573 Oct 01 04:22:27.462239 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 255/536] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:27 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:22:28.409073 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0a29fa24-afdb-4707-80ee-8d3ed53d9923 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:28.409592 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0a29fa24-afdb-4707-80ee-8d3ed53d9923 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:28.417111 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0a29fa24-afdb-4707-80ee-8d3ed53d9923 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:28.417599 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0a29fa24-afdb-4707-80ee-8d3ed53d9923 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:28.418031 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0a29fa24-afdb-4707-80ee-8d3ed53d9923 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:28.418722 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0a29fa24-afdb-4707-80ee-8d3ed53d9923 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:28.419204 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0a29fa24-afdb-4707-80ee-8d3ed53d9923 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:28.419622 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0a29fa24-afdb-4707-80ee-8d3ed53d9923 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:28.485268 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c9ea33f1-7276-41b2-8276-f0adfd5e711d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:28.486516 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c9ea33f1-7276-41b2-8276-f0adfd5e711d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:28.493163 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9ea33f1-7276-41b2-8276-f0adfd5e711d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:28.493659 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9ea33f1-7276-41b2-8276-f0adfd5e711d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:28.494090 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9ea33f1-7276-41b2-8276-f0adfd5e711d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:28.494798 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9ea33f1-7276-41b2-8276-f0adfd5e711d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:28.495911 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9ea33f1-7276-41b2-8276-f0adfd5e711d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:28.496356 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9ea33f1-7276-41b2-8276-f0adfd5e711d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:28.584248 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0a29fa24-afdb-4707-80ee-8d3ed53d9923 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:28.592488 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0a29fa24-afdb-4707-80ee-8d3ed53d9923 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:28.594574 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0a29fa24-afdb-4707-80ee-8d3ed53d9923 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:28.595724 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0a29fa24-afdb-4707-80ee-8d3ed53d9923 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1724 microversion: 2.20 time: 0.190770 Oct 01 04:22:28.596279 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 282/537] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:22:28 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:22:28.652914 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c9ea33f1-7276-41b2-8276-f0adfd5e711d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:28.662086 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c9ea33f1-7276-41b2-8276-f0adfd5e711d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1736 microversion: 2.1 time: 0.181108 Oct 01 04:22:28.662591 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 256/538] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:28 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:22:29.620536 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9013e81b-3ae2-43b6-8480-5b473f2c9894 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:29.621110 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9013e81b-3ae2-43b6-8480-5b473f2c9894 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:29.628103 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9013e81b-3ae2-43b6-8480-5b473f2c9894 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:29.628588 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9013e81b-3ae2-43b6-8480-5b473f2c9894 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:29.629042 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9013e81b-3ae2-43b6-8480-5b473f2c9894 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:29.629874 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9013e81b-3ae2-43b6-8480-5b473f2c9894 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:29.630335 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9013e81b-3ae2-43b6-8480-5b473f2c9894 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:29.630758 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9013e81b-3ae2-43b6-8480-5b473f2c9894 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:29.685350 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f86eb1a5-3642-4201-84e3-18f9c284f18a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:29.686026 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f86eb1a5-3642-4201-84e3-18f9c284f18a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:29.693423 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f86eb1a5-3642-4201-84e3-18f9c284f18a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:29.693912 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f86eb1a5-3642-4201-84e3-18f9c284f18a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:29.694537 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f86eb1a5-3642-4201-84e3-18f9c284f18a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:29.695239 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f86eb1a5-3642-4201-84e3-18f9c284f18a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:29.695899 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f86eb1a5-3642-4201-84e3-18f9c284f18a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:29.696327 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f86eb1a5-3642-4201-84e3-18f9c284f18a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:29.701006 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-9013e81b-3ae2-43b6-8480-5b473f2c9894 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:29.710791 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-9013e81b-3ae2-43b6-8480-5b473f2c9894 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:29.712585 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-9013e81b-3ae2-43b6-8480-5b473f2c9894 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:29.713905 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9013e81b-3ae2-43b6-8480-5b473f2c9894 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1656 microversion: 2.20 time: 0.097400 Oct 01 04:22:29.714533 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 283/539] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:22:29 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1656 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:22:29.812844 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-3cd66ec3-eb22-4b82-831d-e39e3beced91 req-bc783ed3-4232-4087-9165-284e20f75453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e14e3570-67e7-43d6-bcaf-6688168956b2", "name": "network-vif-deleted", "tag": "28ed6420-e14b-48a2-a448-a8ab736b93af"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:22:29.822715 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3cd66ec3-eb22-4b82-831d-e39e3beced91 req-bc783ed3-4232-4087-9165-284e20f75453 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:29.823439 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3cd66ec3-eb22-4b82-831d-e39e3beced91 req-bc783ed3-4232-4087-9165-284e20f75453 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:29.823865 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-3cd66ec3-eb22-4b82-831d-e39e3beced91 req-bc783ed3-4232-4087-9165-284e20f75453 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:29.837143 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-3cd66ec3-eb22-4b82-831d-e39e3beced91 req-bc783ed3-4232-4087-9165-284e20f75453 service nova] Creating event network-vif-deleted:28ed6420-e14b-48a2-a448-a8ab736b93af for instance e14e3570-67e7-43d6-bcaf-6688168956b2 on hv-cinder-86004 Oct 01 04:22:29.842576 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-3cd66ec3-eb22-4b82-831d-e39e3beced91 req-bc783ed3-4232-4087-9165-284e20f75453 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033766 Oct 01 04:22:29.843897 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 284/540] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:22:29.865597 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-f86eb1a5-3642-4201-84e3-18f9c284f18a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:29.874333 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f86eb1a5-3642-4201-84e3-18f9c284f18a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1736 microversion: 2.1 time: 0.194068 Oct 01 04:22:29.875010 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 257/541] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:29 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1736 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:30.741325 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-999c53f2-7d20-4f56-b881-12f305cca279 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:30.742138 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-999c53f2-7d20-4f56-b881-12f305cca279 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:30.749076 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-999c53f2-7d20-4f56-b881-12f305cca279 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:30.750663 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-999c53f2-7d20-4f56-b881-12f305cca279 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:30.751106 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-999c53f2-7d20-4f56-b881-12f305cca279 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:30.751813 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-999c53f2-7d20-4f56-b881-12f305cca279 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:30.752269 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-999c53f2-7d20-4f56-b881-12f305cca279 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:30.752705 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-999c53f2-7d20-4f56-b881-12f305cca279 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:30.757018 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:30.787075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-999c53f2-7d20-4f56-b881-12f305cca279 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:30.787560 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-999c53f2-7d20-4f56-b881-12f305cca279 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:30.788036 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-999c53f2-7d20-4f56-b881-12f305cca279 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:30.788445 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-999c53f2-7d20-4f56-b881-12f305cca279 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lazy-loading 'fault' on Instance uuid e14e3570-67e7-43d6-bcaf-6688168956b2 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:22:30.835885 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-999c53f2-7d20-4f56-b881-12f305cca279 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:30.844356 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-999c53f2-7d20-4f56-b881-12f305cca279 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:30.845927 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-999c53f2-7d20-4f56-b881-12f305cca279 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:30.846980 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-999c53f2-7d20-4f56-b881-12f305cca279 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 200 len: 1372 microversion: 2.20 time: 0.109920 Oct 01 04:22:30.847533 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 285/542] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:22:30 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 1372 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:22:30.898239 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-35e4de3d-59cb-4d94-acef-59a96cbfb600 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:30.899004 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-35e4de3d-59cb-4d94-acef-59a96cbfb600 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:30.905579 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-35e4de3d-59cb-4d94-acef-59a96cbfb600 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:30.906068 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-35e4de3d-59cb-4d94-acef-59a96cbfb600 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:30.906498 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-35e4de3d-59cb-4d94-acef-59a96cbfb600 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:30.907230 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-35e4de3d-59cb-4d94-acef-59a96cbfb600 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:30.907682 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-35e4de3d-59cb-4d94-acef-59a96cbfb600 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:30.908146 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-35e4de3d-59cb-4d94-acef-59a96cbfb600 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:31.047713 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-35e4de3d-59cb-4d94-acef-59a96cbfb600 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:31.056904 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-35e4de3d-59cb-4d94-acef-59a96cbfb600 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1716 microversion: 2.1 time: 0.163332 Oct 01 04:22:31.057633 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 258/543] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:30 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1716 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:31.181459 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5b5419af-9c77-4ec3-9fc1-11453211fd3d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:31.182040 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5b5419af-9c77-4ec3-9fc1-11453211fd3d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:31.188751 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b5419af-9c77-4ec3-9fc1-11453211fd3d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:31.189266 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b5419af-9c77-4ec3-9fc1-11453211fd3d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:31.189698 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b5419af-9c77-4ec3-9fc1-11453211fd3d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:31.190394 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b5419af-9c77-4ec3-9fc1-11453211fd3d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:31.190842 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b5419af-9c77-4ec3-9fc1-11453211fd3d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:31.191297 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b5419af-9c77-4ec3-9fc1-11453211fd3d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:31.316237 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-5b5419af-9c77-4ec3-9fc1-11453211fd3d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] HTTP exception thrown: Cannot 'detach_volume' instance c6436bdc-2e17-43d4-a123-900e6269e551 while it is in vm_state rescued Oct 01 04:22:31.317845 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5b5419af-9c77-4ec3-9fc1-11453211fd3d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Request method failure captured: Oct 01 04:22:31.317845 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551/os-volume_attachments/102b99cd-166f-4162-8578-a607b1c2f69f HTTP/1.1 Oct 01 04:22:31.317845 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:22:31.317845 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:22:31.317845 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:22:31.317845 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 0 Oct 01 04:22:31.317845 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:22:31.317845 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:22:31.317845 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:22:31.317845 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:22:31.317845 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN798A6ygEUFvvEkcfI7qSReKm2UxYzhCs2jYOOZOKUwCn2ocBNad4QsSD0Sc-uPRwf-i9kYKShvHWEgE5cSJRSUVxzLODzJsRfhomt7f51LXA4cAEZPLR8V-qxh0s5PTjrnOKdB2TN8W0JHxgE-z-knV9MsYBlFX3ZzUCq-ESRHWKW8 Oct 01 04:22:31.317845 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:22:31.317845 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:22:31.317845 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:22:31.317845 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:22:31.317845 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:22:31.317845 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:22:31.317845 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: 839c91c5262a49768c3e937b5a034137 Oct 01 04:22:31.317845 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-94604636 Oct 01 04:22:31.317845 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:22:31.317845 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:22:31.319434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_839c91c5262a49768c3e937b5a034137"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/839c91c5262a49768c3e937b5a034137"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/839c91c5262a49768c3e937b5a034137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/839c91c5262a49768c3e937b5a034137"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:22:31.319434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-ServerRescueNegativeTestJSON-94604636 Oct 01 04:22:31.319434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 839c91c5262a49768c3e937b5a034137 Oct 01 04:22:31.319434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-94604636 Oct 01 04:22:31.319434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-ServerRescueNegativeTestJSON-94604636-project Oct 01 04:22:31.319434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:22:31.319434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:22:31.319434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: 7014a1defd81461787318bc27d56b9aa Oct 01 04:22:31.319434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-ServerRescueNegativeTestJSON-94604636-project Oct 01 04:22:31.319434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: > Oct 01 04:22:31.319434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Cannot 'detach_volume' instance c6436bdc-2e17-43d4-a123-900e6269e551 while it is in vm_state rescued Oct 01 04:22:31.320296 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'server_id': 'c6436bdc-2e17-43d4-a123-900e6269e551', 'id': '102b99cd-166f-4162-8578-a607b1c2f69f'} Oct 01 04:22:31.320296 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:22:31.320296 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:22:31.320296 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 01 04:22:31.320296 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 01 04:22:31.320296 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 01 04:22:31.320296 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 04:22:31.320296 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 01 04:22:31.320296 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 01 04:22:31.320296 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c6436bdc-2e17-43d4-a123-900e6269e551 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 01 04:22:31.320296 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:22:31.320296 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:22:31.320296 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:22:31.320296 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:22:31.320296 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:22:31.320296 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:22:31.320296 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:22:31.320296 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:22:31.320296 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:22:31.320296 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:22:31.321820 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 01 04:22:31.321820 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 01 04:22:31.321820 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 01 04:22:31.321820 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 01 04:22:31.321820 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c6436bdc-2e17-43d4-a123-900e6269e551 while it is in vm_state rescued Oct 01 04:22:31.321820 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:22:31.321820 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:22:31.321820 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:22:31.321820 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:22:31.321820 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:22:31.321820 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:22:31.321820 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:22:31.321820 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:22:31.321820 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c6436bdc-2e17-43d4-a123-900e6269e551 while it is in vm_state rescued Oct 01 04:22:31.321820 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:22:31.321820 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5b5419af-9c77-4ec3-9fc1-11453211fd3d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Returning 409 to user: Cannot 'detach_volume' instance c6436bdc-2e17-43d4-a123-900e6269e551 while it is in vm_state rescued {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:22:31.323005 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5b5419af-9c77-4ec3-9fc1-11453211fd3d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551/os-volume_attachments/102b99cd-166f-4162-8578-a607b1c2f69f" status: 409 len: 152 microversion: 2.1 time: 0.142368 Oct 01 04:22:31.323005 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 286/544] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 1 04:22:31 2022] DELETE /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551/os-volume_attachments/102b99cd-166f-4162-8578-a607b1c2f69f => generated 152 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 01 04:22:31.331559 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7a503c5d-0453-4d88-9ce6-e016b5f3ff41 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:22:31.332183 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7a503c5d-0453-4d88-9ce6-e016b5f3ff41 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:31.338281 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a503c5d-0453-4d88-9ce6-e016b5f3ff41 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:31.338843 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a503c5d-0453-4d88-9ce6-e016b5f3ff41 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:31.339353 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a503c5d-0453-4d88-9ce6-e016b5f3ff41 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:31.340125 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a503c5d-0453-4d88-9ce6-e016b5f3ff41 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:31.340656 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a503c5d-0453-4d88-9ce6-e016b5f3ff41 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:31.341281 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a503c5d-0453-4d88-9ce6-e016b5f3ff41 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:31.408324 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7a503c5d-0453-4d88-9ce6-e016b5f3ff41 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "POST /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551/action" status: 202 len: 0 microversion: 2.1 time: 0.080363 Oct 01 04:22:31.412200 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 259/545] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 1 04:22:31 2022] POST /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 04:22:31.417415 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1f338d10-2dbd-4cf4-806f-beb572263c91 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:31.418028 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1f338d10-2dbd-4cf4-806f-beb572263c91 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:31.424512 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f338d10-2dbd-4cf4-806f-beb572263c91 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:31.424957 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f338d10-2dbd-4cf4-806f-beb572263c91 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:31.425394 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f338d10-2dbd-4cf4-806f-beb572263c91 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:31.426164 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f338d10-2dbd-4cf4-806f-beb572263c91 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:31.426610 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f338d10-2dbd-4cf4-806f-beb572263c91 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:31.427100 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1f338d10-2dbd-4cf4-806f-beb572263c91 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:31.588071 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1f338d10-2dbd-4cf4-806f-beb572263c91 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:31.597409 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1f338d10-2dbd-4cf4-806f-beb572263c91 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1724 microversion: 2.1 time: 0.183829 Oct 01 04:22:31.597979 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 287/546] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:31 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:31.873370 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-223fe7f9-c7ee-4bae-b3ec-c615f369a5e6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:31.874708 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-223fe7f9-c7ee-4bae-b3ec-c615f369a5e6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:31.881055 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-223fe7f9-c7ee-4bae-b3ec-c615f369a5e6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:31.881542 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-223fe7f9-c7ee-4bae-b3ec-c615f369a5e6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:31.882004 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-223fe7f9-c7ee-4bae-b3ec-c615f369a5e6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:31.882728 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-223fe7f9-c7ee-4bae-b3ec-c615f369a5e6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:31.883186 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-223fe7f9-c7ee-4bae-b3ec-c615f369a5e6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:31.883616 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-223fe7f9-c7ee-4bae-b3ec-c615f369a5e6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:31.898914 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-223fe7f9-c7ee-4bae-b3ec-c615f369a5e6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] HTTP exception thrown: Instance e14e3570-67e7-43d6-bcaf-6688168956b2 could not be found. Oct 01 04:22:31.900565 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-223fe7f9-c7ee-4bae-b3ec-c615f369a5e6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Request method failure captured: Oct 01 04:22:31.900565 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 HTTP/1.1 Oct 01 04:22:31.900565 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept: application/json Oct 01 04:22:31.900565 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept-Encoding: identity Oct 01 04:22:31.900565 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Connection: close Oct 01 04:22:31.900565 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Length: 0 Oct 01 04:22:31.900565 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Type: application/json Oct 01 04:22:31.900565 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Host: 10.222.0.26 Oct 01 04:22:31.900565 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 01 04:22:31.900565 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 01 04:22:31.900565 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjN795k9lom01fxGasAf7dSFhEWKXNxA30ntET0DRM7p76a-qiBZjhY00TAAXxmtMK0Zho6OdoZHdd3uuDw_LfHZjzKVGmiYxUUKYRH8YNvYwho1fOjxLAH0AbPKI5uJGWu39VRVIbh0ABAVTZdGSxEl07LhSox3pjzydDV3DB0ft1smI Oct 01 04:22:31.900565 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Id: None Oct 01 04:22:31.900565 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Name: None Oct 01 04:22:31.900565 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 01 04:22:31.900565 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 01 04:22:31.900565 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Openstack-Nova-Api-Version: 2.20 Oct 01 04:22:31.900565 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 01 04:22:31.900565 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 01 04:22:31.900565 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Id: 19d87f6d9adf4ce98e934187ec8ae0d7 Oct 01 04:22:31.900565 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1941075162 Oct 01 04:22:31.900565 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Role: reader,member Oct 01 04:22:31.900565 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Roles: reader,member Oct 01 04:22:31.902173 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_19d87f6d9adf4ce98e934187ec8ae0d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/19d87f6d9adf4ce98e934187ec8ae0d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/19d87f6d9adf4ce98e934187ec8ae0d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/19d87f6d9adf4ce98e934187ec8ae0d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:22:31.902173 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1941075162 Oct 01 04:22:31.902173 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Id: 19d87f6d9adf4ce98e934187ec8ae0d7 Oct 01 04:22:31.902173 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1941075162 Oct 01 04:22:31.902173 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User: tempest-AttachVolumeShelveTestJSON-1941075162-project Oct 01 04:22:31.902173 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 01 04:22:31.902173 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 01 04:22:31.902173 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Id: ccd631925a0a4f5ca8be5d3915778487 Oct 01 04:22:31.902173 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1941075162-project Oct 01 04:22:31.902173 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: method: > Oct 01 04:22:31.902173 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: exception: Instance e14e3570-67e7-43d6-bcaf-6688168956b2 could not be found. Oct 01 04:22:31.902173 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: action_args: {'id': 'e14e3570-67e7-43d6-bcaf-6688168956b2'} Oct 01 04:22:31.903088 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:22:31.903088 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:22:31.903088 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:22:31.903088 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:22:31.903088 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:22:31.903088 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:22:31.903088 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:22:31.903088 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:22:31.903088 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:22:31.903088 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:22:31.903088 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e14e3570-67e7-43d6-bcaf-6688168956b2 could not be found. Oct 01 04:22:31.903088 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:22:31.903088 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:22:31.903088 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:22:31.903088 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:22:31.903088 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:22:31.903088 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:22:31.903088 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:22:31.903088 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:22:31.903088 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:22:31.904573 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:22:31.904573 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:22:31.904573 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:22:31.904573 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:22:31.904573 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:22:31.904573 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:22:31.904573 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:22:31.904573 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e14e3570-67e7-43d6-bcaf-6688168956b2 could not be found. Oct 01 04:22:31.904573 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:22:31.904573 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:22:31.904573 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:22:31.904573 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:22:31.904573 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:22:31.904573 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:22:31.904573 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:22:31.904573 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:22:31.904573 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e14e3570-67e7-43d6-bcaf-6688168956b2 could not be found. Oct 01 04:22:31.904573 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:22:31.906734 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-223fe7f9-c7ee-4bae-b3ec-c615f369a5e6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Returning 404 to user: Instance e14e3570-67e7-43d6-bcaf-6688168956b2 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:22:31.906734 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-223fe7f9-c7ee-4bae-b3ec-c615f369a5e6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 404 len: 111 microversion: 2.20 time: 0.033021 Oct 01 04:22:31.907200 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 260/547] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:22:31 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 04:22:31.914872 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cc122a5e-d89d-42e8-9e88-d6690b0bb666 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '.version_select at 0x7fdfbeb421f0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:31.950346 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cc122a5e-d89d-42e8-9e88-d6690b0bb666 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1577233801" status: 204 len: 0 microversion: 2.20 time: 0.039237 Oct 01 04:22:31.951203 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 288/548] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 1 04:22:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1577233801 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 04:22:32.619661 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-80b0ad3f-6126-459d-bc9a-2aca8de1dc78 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:32.620503 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-80b0ad3f-6126-459d-bc9a-2aca8de1dc78 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:32.628197 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80b0ad3f-6126-459d-bc9a-2aca8de1dc78 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:32.628758 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80b0ad3f-6126-459d-bc9a-2aca8de1dc78 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:32.629291 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80b0ad3f-6126-459d-bc9a-2aca8de1dc78 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:32.629873 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dc028ca5-2322-4fa5-86b3-db27934acf33 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Action: 'create', calling method: .version_select at 0x7fdfbe8a9a60>, body: {"keypair": {"name": "tempest-keypair-1959557846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApwP81tgoSp5DV0k/xkUlD3qDNvSiGcXKpqT2oifDNFdQHdK1OFesHQ0mRQHPatPcdGwFNmEJ0tcw0ZMlEnsqB41sdqJfxlWf8f1AAQ6yql/TaATJBl9LXSNcaMEmfq1A=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:22:32.630141 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80b0ad3f-6126-459d-bc9a-2aca8de1dc78 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:32.630663 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80b0ad3f-6126-459d-bc9a-2aca8de1dc78 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:32.631151 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-80b0ad3f-6126-459d-bc9a-2aca8de1dc78 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:32.649733 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-dc028ca5-2322-4fa5-86b3-db27934acf33 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Getting quotas for project 19d87f6d9adf4ce98e934187ec8ae0d7. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:22:32.653538 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-dc028ca5-2322-4fa5-86b3-db27934acf33 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Getting quotas for user ccd631925a0a4f5ca8be5d3915778487 and project 19d87f6d9adf4ce98e934187ec8ae0d7. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:22:32.678058 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dc028ca5-2322-4fa5-86b3-db27934acf33 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.051880 Oct 01 04:22:32.678918 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 289/549] 10.222.0.26 () {62 vars in 1200 bytes} [Sat Oct 1 04:22:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 01 04:22:32.773204 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-80b0ad3f-6126-459d-bc9a-2aca8de1dc78 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:32.775529 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:32.783808 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-80b0ad3f-6126-459d-bc9a-2aca8de1dc78 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1724 microversion: 2.1 time: 0.168024 Oct 01 04:22:32.797117 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 261/550] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:32 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:33.808627 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-97ebc222-9caf-46f6-b144-e8c6c2edcd6d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:33.809218 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-97ebc222-9caf-46f6-b144-e8c6c2edcd6d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:33.816460 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97ebc222-9caf-46f6-b144-e8c6c2edcd6d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:33.816974 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97ebc222-9caf-46f6-b144-e8c6c2edcd6d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:33.817412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97ebc222-9caf-46f6-b144-e8c6c2edcd6d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:33.818110 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97ebc222-9caf-46f6-b144-e8c6c2edcd6d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:33.818568 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97ebc222-9caf-46f6-b144-e8c6c2edcd6d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:33.818993 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97ebc222-9caf-46f6-b144-e8c6c2edcd6d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:33.940515 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-14d2e61a-0090-454e-ad01-d1cc131ff23c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1446649270", "imageRef": "c63d52d7-4e3d-40cf-a8b5-59a2d027d793", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "41ad6d82-393d-469b-ad56-b82ab9a77fee"}], "security_groups": [{"name": "tempest-securitygroup--1989607045"}], "key_name": "tempest-keypair-1959557846", "user_data": "}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:22:33.949450 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:33.956005 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-97ebc222-9caf-46f6-b144-e8c6c2edcd6d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:33.964918 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-97ebc222-9caf-46f6-b144-e8c6c2edcd6d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1724 microversion: 2.1 time: 0.160310 Oct 01 04:22:33.965502 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 290/551] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:33 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:34.048022 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-14d2e61a-0090-454e-ad01-d1cc131ff23c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] validate_networks() for [('41ad6d82-393d-469b-ad56-b82ab9a77fee', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 04:22:34.424267 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-14d2e61a-0090-454e-ad01-d1cc131ff23c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 04:22:34.424692 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-14d2e61a-0090-454e-ad01-d1cc131ff23c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 04:22:34.425195 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-14d2e61a-0090-454e-ad01-d1cc131ff23c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 04:22:34.425605 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-14d2e61a-0090-454e-ad01-d1cc131ff23c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 04:22:34.426015 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-14d2e61a-0090-454e-ad01-d1cc131ff23c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 04:22:34.434630 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14d2e61a-0090-454e-ad01-d1cc131ff23c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:34.435107 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14d2e61a-0090-454e-ad01-d1cc131ff23c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:34.435537 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14d2e61a-0090-454e-ad01-d1cc131ff23c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:34.436258 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14d2e61a-0090-454e-ad01-d1cc131ff23c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:34.436736 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14d2e61a-0090-454e-ad01-d1cc131ff23c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:34.437279 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14d2e61a-0090-454e-ad01-d1cc131ff23c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:34.453439 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-14d2e61a-0090-454e-ad01-d1cc131ff23c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Getting quotas for project 19d87f6d9adf4ce98e934187ec8ae0d7. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:22:34.457661 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-14d2e61a-0090-454e-ad01-d1cc131ff23c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Getting quotas for user ccd631925a0a4f5ca8be5d3915778487 and project 19d87f6d9adf4ce98e934187ec8ae0d7. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:22:34.468822 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-14d2e61a-0090-454e-ad01-d1cc131ff23c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 04:22:34.471097 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-14d2e61a-0090-454e-ad01-d1cc131ff23c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c63d52d7-4e3d-40cf-a8b5-59a2d027d793',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 04:22:34.518374 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-14d2e61a-0090-454e-ad01-d1cc131ff23c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.582969 Oct 01 04:22:34.519207 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 262/552] 10.222.0.26 () {62 vars in 1188 bytes} [Sat Oct 1 04:22:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 01 04:22:34.531152 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7cf06d4a-91c2-4ce6-915c-41f2abf4263f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:34.531968 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7cf06d4a-91c2-4ce6-915c-41f2abf4263f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:34.584875 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7cf06d4a-91c2-4ce6-915c-41f2abf4263f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:34.592249 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7cf06d4a-91c2-4ce6-915c-41f2abf4263f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:34.594414 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7cf06d4a-91c2-4ce6-915c-41f2abf4263f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:34.595612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7cf06d4a-91c2-4ce6-915c-41f2abf4263f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1282 microversion: 2.20 time: 0.068978 Oct 01 04:22:34.596370 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 291/553] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:22:34 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1282 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:22:34.988431 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f58766c8-3c7b-4945-b1bc-c53f501ce399 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:34.989007 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f58766c8-3c7b-4945-b1bc-c53f501ce399 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:34.995612 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f58766c8-3c7b-4945-b1bc-c53f501ce399 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:34.996103 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f58766c8-3c7b-4945-b1bc-c53f501ce399 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:34.996534 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f58766c8-3c7b-4945-b1bc-c53f501ce399 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:34.997283 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f58766c8-3c7b-4945-b1bc-c53f501ce399 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:34.997739 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f58766c8-3c7b-4945-b1bc-c53f501ce399 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:34.998160 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f58766c8-3c7b-4945-b1bc-c53f501ce399 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:35.137404 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-f58766c8-3c7b-4945-b1bc-c53f501ce399 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:35.149054 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f58766c8-3c7b-4945-b1bc-c53f501ce399 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1730 microversion: 2.1 time: 0.165124 Oct 01 04:22:35.149627 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 263/554] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:34 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:35.171810 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6081e18c-8433-4922-9682-f168384a4ba9 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:35.172311 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6081e18c-8433-4922-9682-f168384a4ba9 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:35.178671 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6081e18c-8433-4922-9682-f168384a4ba9 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:35.179162 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6081e18c-8433-4922-9682-f168384a4ba9 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:35.179592 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6081e18c-8433-4922-9682-f168384a4ba9 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:35.180280 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6081e18c-8433-4922-9682-f168384a4ba9 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:35.180728 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6081e18c-8433-4922-9682-f168384a4ba9 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:35.181211 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6081e18c-8433-4922-9682-f168384a4ba9 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:35.263726 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6081e18c-8433-4922-9682-f168384a4ba9 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095903 Oct 01 04:22:35.264304 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 292/555] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 1 04:22:35 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:22:35.620020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cac2c43c-45f5-45f8-b79c-e559cc775eef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:35.620620 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cac2c43c-45f5-45f8-b79c-e559cc775eef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:35.627332 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cac2c43c-45f5-45f8-b79c-e559cc775eef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:35.627821 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cac2c43c-45f5-45f8-b79c-e559cc775eef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:35.628262 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cac2c43c-45f5-45f8-b79c-e559cc775eef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:35.628980 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cac2c43c-45f5-45f8-b79c-e559cc775eef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:35.629441 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cac2c43c-45f5-45f8-b79c-e559cc775eef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:35.629865 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cac2c43c-45f5-45f8-b79c-e559cc775eef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:35.723554 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-cac2c43c-45f5-45f8-b79c-e559cc775eef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:35.741924 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-cac2c43c-45f5-45f8-b79c-e559cc775eef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:35.744986 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-cac2c43c-45f5-45f8-b79c-e559cc775eef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:35.746605 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cac2c43c-45f5-45f8-b79c-e559cc775eef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1342 microversion: 2.20 time: 0.130762 Oct 01 04:22:35.747622 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 264/556] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:22:35 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1342 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:22:36.218180 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-67ef957d-d7e8-4276-b1b7-6b159920e2f4 req-1745f646-882b-4f6e-8178-ff6286a32208 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6436bdc-2e17-43d4-a123-900e6269e551", "tag": "2a43b463-65b3-423d-b16f-bcbd2964f478"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:22:36.231629 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-67ef957d-d7e8-4276-b1b7-6b159920e2f4 req-1745f646-882b-4f6e-8178-ff6286a32208 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:36.233320 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-67ef957d-d7e8-4276-b1b7-6b159920e2f4 req-1745f646-882b-4f6e-8178-ff6286a32208 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:36.234727 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-67ef957d-d7e8-4276-b1b7-6b159920e2f4 req-1745f646-882b-4f6e-8178-ff6286a32208 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:36.250868 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-67ef957d-d7e8-4276-b1b7-6b159920e2f4 req-1745f646-882b-4f6e-8178-ff6286a32208 service nova] Creating event network-changed:2a43b463-65b3-423d-b16f-bcbd2964f478 for instance c6436bdc-2e17-43d4-a123-900e6269e551 on hv-cinder-86004 Oct 01 04:22:36.256818 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-67ef957d-d7e8-4276-b1b7-6b159920e2f4 req-1745f646-882b-4f6e-8178-ff6286a32208 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044545 Oct 01 04:22:36.257489 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 293/557] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:22:36.772832 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c14f6cc6-4fb6-4520-9174-d3c7e21bc073 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:36.773631 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c14f6cc6-4fb6-4520-9174-d3c7e21bc073 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:36.780835 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c14f6cc6-4fb6-4520-9174-d3c7e21bc073 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:36.781554 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c14f6cc6-4fb6-4520-9174-d3c7e21bc073 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:36.782102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c14f6cc6-4fb6-4520-9174-d3c7e21bc073 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:36.782919 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c14f6cc6-4fb6-4520-9174-d3c7e21bc073 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:36.783527 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c14f6cc6-4fb6-4520-9174-d3c7e21bc073 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:36.784061 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c14f6cc6-4fb6-4520-9174-d3c7e21bc073 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:36.936823 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c14f6cc6-4fb6-4520-9174-d3c7e21bc073 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:36.946966 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c14f6cc6-4fb6-4520-9174-d3c7e21bc073 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:36.949035 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c14f6cc6-4fb6-4520-9174-d3c7e21bc073 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:36.950379 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c14f6cc6-4fb6-4520-9174-d3c7e21bc073 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1408 microversion: 2.20 time: 0.182495 Oct 01 04:22:36.965449 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 265/558] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:22:36 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:22:37.718740 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-f20042e5-84c6-4962-b239-f9f182ee3d95 req-e8c19c4c-0dd8-44f8-a178-4914169fd86b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b21e7357-43a2-4dc9-b0f6-26b14b68c464", "tag": "735577aa-5ec2-48d4-8f41-38cb8f95250a"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:22:37.729439 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f20042e5-84c6-4962-b239-f9f182ee3d95 req-e8c19c4c-0dd8-44f8-a178-4914169fd86b service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:37.730015 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f20042e5-84c6-4962-b239-f9f182ee3d95 req-e8c19c4c-0dd8-44f8-a178-4914169fd86b service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:37.730515 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-f20042e5-84c6-4962-b239-f9f182ee3d95 req-e8c19c4c-0dd8-44f8-a178-4914169fd86b service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:37.742302 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-f20042e5-84c6-4962-b239-f9f182ee3d95 req-e8c19c4c-0dd8-44f8-a178-4914169fd86b service nova] Creating event network-changed:735577aa-5ec2-48d4-8f41-38cb8f95250a for instance b21e7357-43a2-4dc9-b0f6-26b14b68c464 on hv-cinder-86004 Oct 01 04:22:37.747168 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-f20042e5-84c6-4962-b239-f9f182ee3d95 req-e8c19c4c-0dd8-44f8-a178-4914169fd86b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035977 Oct 01 04:22:37.747764 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 294/559] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:22:37.977016 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3bc69c13-e0c4-426f-8552-623c5829b1e3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:37.977658 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3bc69c13-e0c4-426f-8552-623c5829b1e3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:37.984384 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3bc69c13-e0c4-426f-8552-623c5829b1e3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:37.984881 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3bc69c13-e0c4-426f-8552-623c5829b1e3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:37.985383 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3bc69c13-e0c4-426f-8552-623c5829b1e3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:37.986089 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3bc69c13-e0c4-426f-8552-623c5829b1e3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:37.986602 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3bc69c13-e0c4-426f-8552-623c5829b1e3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:37.987112 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3bc69c13-e0c4-426f-8552-623c5829b1e3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:38.124874 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-3bc69c13-e0c4-426f-8552-623c5829b1e3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:38.133894 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-3bc69c13-e0c4-426f-8552-623c5829b1e3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:38.136597 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-3bc69c13-e0c4-426f-8552-623c5829b1e3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:38.137772 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3bc69c13-e0c4-426f-8552-623c5829b1e3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1408 microversion: 2.20 time: 0.164740 Oct 01 04:22:38.138328 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 266/560] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:22:37 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:22:38.272376 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-9ad0feaf-0f0f-4d20-bd4c-7d399fbe4476 req-d936045d-4699-4377-9fa4-5dca969783f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6436bdc-2e17-43d4-a123-900e6269e551", "tag": "2a43b463-65b3-423d-b16f-bcbd2964f478"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:22:38.282373 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9ad0feaf-0f0f-4d20-bd4c-7d399fbe4476 req-d936045d-4699-4377-9fa4-5dca969783f9 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:38.282843 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9ad0feaf-0f0f-4d20-bd4c-7d399fbe4476 req-d936045d-4699-4377-9fa4-5dca969783f9 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:38.283272 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9ad0feaf-0f0f-4d20-bd4c-7d399fbe4476 req-d936045d-4699-4377-9fa4-5dca969783f9 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:38.293693 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-9ad0feaf-0f0f-4d20-bd4c-7d399fbe4476 req-d936045d-4699-4377-9fa4-5dca969783f9 service nova] Creating event network-changed:2a43b463-65b3-423d-b16f-bcbd2964f478 for instance c6436bdc-2e17-43d4-a123-900e6269e551 on hv-cinder-86004 Oct 01 04:22:38.298991 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-9ad0feaf-0f0f-4d20-bd4c-7d399fbe4476 req-d936045d-4699-4377-9fa4-5dca969783f9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030650 Oct 01 04:22:38.299543 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 295/561] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:22:39.163661 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-99f74b2b-65d0-43a7-a145-87784a122f45 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:39.164279 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-99f74b2b-65d0-43a7-a145-87784a122f45 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:39.170712 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99f74b2b-65d0-43a7-a145-87784a122f45 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:39.171199 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99f74b2b-65d0-43a7-a145-87784a122f45 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:39.171643 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99f74b2b-65d0-43a7-a145-87784a122f45 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:39.172349 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99f74b2b-65d0-43a7-a145-87784a122f45 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:39.172811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99f74b2b-65d0-43a7-a145-87784a122f45 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:39.173270 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-99f74b2b-65d0-43a7-a145-87784a122f45 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:39.302181 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-99f74b2b-65d0-43a7-a145-87784a122f45 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:39.310448 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-99f74b2b-65d0-43a7-a145-87784a122f45 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:39.312129 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-99f74b2b-65d0-43a7-a145-87784a122f45 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:39.313167 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-99f74b2b-65d0-43a7-a145-87784a122f45 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1408 microversion: 2.20 time: 0.153374 Oct 01 04:22:39.313739 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 267/562] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:22:39 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:22:40.340029 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-67a54866-c4f8-417b-a2ca-c4567c30d17d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:40.340716 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-67a54866-c4f8-417b-a2ca-c4567c30d17d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:40.347153 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67a54866-c4f8-417b-a2ca-c4567c30d17d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:40.347643 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67a54866-c4f8-417b-a2ca-c4567c30d17d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:40.348088 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67a54866-c4f8-417b-a2ca-c4567c30d17d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:40.348782 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67a54866-c4f8-417b-a2ca-c4567c30d17d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:40.349281 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67a54866-c4f8-417b-a2ca-c4567c30d17d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:40.349713 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-67a54866-c4f8-417b-a2ca-c4567c30d17d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:40.659937 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-67a54866-c4f8-417b-a2ca-c4567c30d17d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:40.667819 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-67a54866-c4f8-417b-a2ca-c4567c30d17d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:40.669268 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-67a54866-c4f8-417b-a2ca-c4567c30d17d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:40.670929 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-67a54866-c4f8-417b-a2ca-c4567c30d17d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1408 microversion: 2.20 time: 0.335092 Oct 01 04:22:40.671777 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 296/563] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:22:40 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1408 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:22:41.696796 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-20e689e5-8d82-4c21-90a6-7ee526aeb4fe tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:41.697583 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-20e689e5-8d82-4c21-90a6-7ee526aeb4fe tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:41.706878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20e689e5-8d82-4c21-90a6-7ee526aeb4fe tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:41.707416 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20e689e5-8d82-4c21-90a6-7ee526aeb4fe tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:41.708047 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20e689e5-8d82-4c21-90a6-7ee526aeb4fe tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:41.708780 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20e689e5-8d82-4c21-90a6-7ee526aeb4fe tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:41.709274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20e689e5-8d82-4c21-90a6-7ee526aeb4fe tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:41.709712 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-20e689e5-8d82-4c21-90a6-7ee526aeb4fe tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:41.846835 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-20e689e5-8d82-4c21-90a6-7ee526aeb4fe tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:41.854891 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-20e689e5-8d82-4c21-90a6-7ee526aeb4fe tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:41.856373 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-20e689e5-8d82-4c21-90a6-7ee526aeb4fe tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:41.857532 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-20e689e5-8d82-4c21-90a6-7ee526aeb4fe tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1408 microversion: 2.20 time: 0.164737 Oct 01 04:22:41.858846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 268/564] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:22:41 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:22:42.530204 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-174b7f77-3693-4c74-b931-b08d1fdb1e6f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:42.532429 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-174b7f77-3693-4c74-b931-b08d1fdb1e6f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:42.539013 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-174b7f77-3693-4c74-b931-b08d1fdb1e6f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:42.539504 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-174b7f77-3693-4c74-b931-b08d1fdb1e6f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:42.539942 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-174b7f77-3693-4c74-b931-b08d1fdb1e6f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:42.540636 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-174b7f77-3693-4c74-b931-b08d1fdb1e6f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:42.541131 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-174b7f77-3693-4c74-b931-b08d1fdb1e6f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:42.541558 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-174b7f77-3693-4c74-b931-b08d1fdb1e6f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:42.570027 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-174b7f77-3693-4c74-b931-b08d1fdb1e6f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043782 Oct 01 04:22:42.570758 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 297/565] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 1 04:22:42 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 04:22:42.633168 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-58501077-1d0b-40ba-92f7-dbbf06185cf7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:42.633671 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-58501077-1d0b-40ba-92f7-dbbf06185cf7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:42.640202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58501077-1d0b-40ba-92f7-dbbf06185cf7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:42.640693 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58501077-1d0b-40ba-92f7-dbbf06185cf7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:42.641161 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58501077-1d0b-40ba-92f7-dbbf06185cf7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:42.641856 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58501077-1d0b-40ba-92f7-dbbf06185cf7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:42.642318 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58501077-1d0b-40ba-92f7-dbbf06185cf7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:42.642747 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-58501077-1d0b-40ba-92f7-dbbf06185cf7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:42.667312 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-58501077-1d0b-40ba-92f7-dbbf06185cf7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 04:22:42.747733 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-58501077-1d0b-40ba-92f7-dbbf06185cf7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 204 len: 0 microversion: 2.1 time: 0.118151 Oct 01 04:22:42.748406 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 269/566] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 1 04:22:42 2022] DELETE /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 04:22:42.758745 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2942e430-e4ec-43a0-94f4-61a54e7ec14a tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:42.759528 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2942e430-e4ec-43a0-94f4-61a54e7ec14a tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:42.765748 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2942e430-e4ec-43a0-94f4-61a54e7ec14a tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:42.766244 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2942e430-e4ec-43a0-94f4-61a54e7ec14a tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:42.766690 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2942e430-e4ec-43a0-94f4-61a54e7ec14a tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:42.767390 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2942e430-e4ec-43a0-94f4-61a54e7ec14a tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:42.767851 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2942e430-e4ec-43a0-94f4-61a54e7ec14a tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:42.768278 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2942e430-e4ec-43a0-94f4-61a54e7ec14a tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:42.883383 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-30b63dbc-27f1-49fc-962c-6dee2541ce6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:42.884118 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-30b63dbc-27f1-49fc-962c-6dee2541ce6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:42.890185 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30b63dbc-27f1-49fc-962c-6dee2541ce6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:42.890681 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30b63dbc-27f1-49fc-962c-6dee2541ce6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:42.891125 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30b63dbc-27f1-49fc-962c-6dee2541ce6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:42.891834 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30b63dbc-27f1-49fc-962c-6dee2541ce6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:42.892299 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30b63dbc-27f1-49fc-962c-6dee2541ce6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:42.892730 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30b63dbc-27f1-49fc-962c-6dee2541ce6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:43.117456 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2942e430-e4ec-43a0-94f4-61a54e7ec14a tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:43.125944 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2942e430-e4ec-43a0-94f4-61a54e7ec14a tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1673 microversion: 2.1 time: 0.372200 Oct 01 04:22:43.126525 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 298/567] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:42 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1673 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:22:43.133213 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-30b63dbc-27f1-49fc-962c-6dee2541ce6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:43.141341 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-30b63dbc-27f1-49fc-962c-6dee2541ce6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:43.142883 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-30b63dbc-27f1-49fc-962c-6dee2541ce6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:43.143996 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-30b63dbc-27f1-49fc-962c-6dee2541ce6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1408 microversion: 2.20 time: 0.264900 Oct 01 04:22:43.144540 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 270/568] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:22:42 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1408 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:22:43.319212 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-79e55b27-3e0c-4162-bb3c-49ef658fbeba req-076520a5-23ba-44a8-bbe7-89d3e2fe65d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b21e7357-43a2-4dc9-b0f6-26b14b68c464", "name": "network-vif-plugged", "status": "completed", "tag": "735577aa-5ec2-48d4-8f41-38cb8f95250a"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:22:43.328555 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-79e55b27-3e0c-4162-bb3c-49ef658fbeba req-076520a5-23ba-44a8-bbe7-89d3e2fe65d9 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:43.329091 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-79e55b27-3e0c-4162-bb3c-49ef658fbeba req-076520a5-23ba-44a8-bbe7-89d3e2fe65d9 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:43.329564 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-79e55b27-3e0c-4162-bb3c-49ef658fbeba req-076520a5-23ba-44a8-bbe7-89d3e2fe65d9 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:43.340854 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-79e55b27-3e0c-4162-bb3c-49ef658fbeba req-076520a5-23ba-44a8-bbe7-89d3e2fe65d9 service nova] Creating event network-vif-plugged:735577aa-5ec2-48d4-8f41-38cb8f95250a for instance b21e7357-43a2-4dc9-b0f6-26b14b68c464 on hv-cinder-86004 Oct 01 04:22:43.346243 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-79e55b27-3e0c-4162-bb3c-49ef658fbeba req-076520a5-23ba-44a8-bbe7-89d3e2fe65d9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030676 Oct 01 04:22:43.346834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 299/569] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:22:44.149711 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cc10cdaf-d502-4914-9911-e047d7ec85f1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:44.150328 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cc10cdaf-d502-4914-9911-e047d7ec85f1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:44.156528 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc10cdaf-d502-4914-9911-e047d7ec85f1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:44.157046 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc10cdaf-d502-4914-9911-e047d7ec85f1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:44.157487 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc10cdaf-d502-4914-9911-e047d7ec85f1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:44.158182 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc10cdaf-d502-4914-9911-e047d7ec85f1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:44.158649 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc10cdaf-d502-4914-9911-e047d7ec85f1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:44.159107 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc10cdaf-d502-4914-9911-e047d7ec85f1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:44.171441 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-652438ba-cb4f-459c-945f-ab23734e32f9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:44.172135 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-652438ba-cb4f-459c-945f-ab23734e32f9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:44.178236 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-652438ba-cb4f-459c-945f-ab23734e32f9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:44.178699 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-652438ba-cb4f-459c-945f-ab23734e32f9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:44.179128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-652438ba-cb4f-459c-945f-ab23734e32f9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:44.179810 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-652438ba-cb4f-459c-945f-ab23734e32f9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:44.180256 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-652438ba-cb4f-459c-945f-ab23734e32f9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:44.180765 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-652438ba-cb4f-459c-945f-ab23734e32f9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:44.358621 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-cc10cdaf-d502-4914-9911-e047d7ec85f1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:44.361754 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-652438ba-cb4f-459c-945f-ab23734e32f9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:44.366461 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cc10cdaf-d502-4914-9911-e047d7ec85f1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1673 microversion: 2.1 time: 0.221107 Oct 01 04:22:44.367118 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 271/570] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:44 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1673 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:44.369892 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-652438ba-cb4f-459c-945f-ab23734e32f9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:44.371335 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-652438ba-cb4f-459c-945f-ab23734e32f9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:44.372497 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-652438ba-cb4f-459c-945f-ab23734e32f9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1408 microversion: 2.20 time: 0.205972 Oct 01 04:22:44.373069 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 300/571] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:22:44 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1408 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:22:45.389826 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2a00de1f-95b6-4801-a9e2-981bb1540a61 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:45.390567 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2a00de1f-95b6-4801-a9e2-981bb1540a61 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:45.392736 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:45.393595 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:45.397950 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-57fe56c6-56cc-442c-84db-05d8fd0558fd tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:45.398774 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-57fe56c6-56cc-442c-84db-05d8fd0558fd tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:45.400496 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a00de1f-95b6-4801-a9e2-981bb1540a61 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:45.401021 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a00de1f-95b6-4801-a9e2-981bb1540a61 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:45.401468 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a00de1f-95b6-4801-a9e2-981bb1540a61 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:45.402179 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a00de1f-95b6-4801-a9e2-981bb1540a61 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:45.402645 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a00de1f-95b6-4801-a9e2-981bb1540a61 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:45.403078 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2a00de1f-95b6-4801-a9e2-981bb1540a61 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:45.405385 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:45.408265 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57fe56c6-56cc-442c-84db-05d8fd0558fd tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:45.408969 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57fe56c6-56cc-442c-84db-05d8fd0558fd tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:45.409412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57fe56c6-56cc-442c-84db-05d8fd0558fd tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:45.410118 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57fe56c6-56cc-442c-84db-05d8fd0558fd tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:45.410743 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57fe56c6-56cc-442c-84db-05d8fd0558fd tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:45.411173 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57fe56c6-56cc-442c-84db-05d8fd0558fd tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:45.493934 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-2a00de1f-95b6-4801-a9e2-981bb1540a61 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:45.502562 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2a00de1f-95b6-4801-a9e2-981bb1540a61 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1605 microversion: 2.1 time: 0.116670 Oct 01 04:22:45.503814 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 272/572] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:45 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1605 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:45.580866 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-57fe56c6-56cc-442c-84db-05d8fd0558fd tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:45.589276 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-57fe56c6-56cc-442c-84db-05d8fd0558fd tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:45.590956 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-57fe56c6-56cc-442c-84db-05d8fd0558fd tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:45.592580 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-57fe56c6-56cc-442c-84db-05d8fd0558fd tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1408 microversion: 2.20 time: 0.198533 Oct 01 04:22:45.593964 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 301/573] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:22:45 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:22:45.618833 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-a8a3ba09-96d8-45e3-87b5-5a05b5a010c0 req-23a749fb-68e6-431f-b583-6f17efe288ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2643a3f-906d-4cb4-8b4f-f2a63557ab69", "name": "network-vif-deleted", "tag": "ada360f6-273f-42d3-babd-7015209fbaac"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:22:45.629834 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a8a3ba09-96d8-45e3-87b5-5a05b5a010c0 req-23a749fb-68e6-431f-b583-6f17efe288ae service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:45.630425 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a8a3ba09-96d8-45e3-87b5-5a05b5a010c0 req-23a749fb-68e6-431f-b583-6f17efe288ae service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:45.630938 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-a8a3ba09-96d8-45e3-87b5-5a05b5a010c0 req-23a749fb-68e6-431f-b583-6f17efe288ae service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:45.642892 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-a8a3ba09-96d8-45e3-87b5-5a05b5a010c0 req-23a749fb-68e6-431f-b583-6f17efe288ae service nova] Creating event network-vif-deleted:ada360f6-273f-42d3-babd-7015209fbaac for instance c2643a3f-906d-4cb4-8b4f-f2a63557ab69 on hv-cinder-86004 Oct 01 04:22:45.648067 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-a8a3ba09-96d8-45e3-87b5-5a05b5a010c0 req-23a749fb-68e6-431f-b583-6f17efe288ae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032581 Oct 01 04:22:45.648727 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 273/574] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:22:46.531357 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d7e94eee-1549-4929-bed3-5153dee41cff tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:46.537634 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d7e94eee-1549-4929-bed3-5153dee41cff tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:46.547651 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7e94eee-1549-4929-bed3-5153dee41cff tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:46.548420 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7e94eee-1549-4929-bed3-5153dee41cff tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:46.549061 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7e94eee-1549-4929-bed3-5153dee41cff tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:46.549775 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7e94eee-1549-4929-bed3-5153dee41cff tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:46.550402 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7e94eee-1549-4929-bed3-5153dee41cff tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:46.550983 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7e94eee-1549-4929-bed3-5153dee41cff tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:46.588674 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7e94eee-1549-4929-bed3-5153dee41cff tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:46.589275 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7e94eee-1549-4929-bed3-5153dee41cff tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:46.589885 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7e94eee-1549-4929-bed3-5153dee41cff tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:46.590485 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-d7e94eee-1549-4929-bed3-5153dee41cff tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lazy-loading 'fault' on Instance uuid c2643a3f-906d-4cb4-8b4f-f2a63557ab69 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:22:46.619525 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bd2dc731-2b87-442b-88a3-81f12f0e9a1a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:46.620213 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bd2dc731-2b87-442b-88a3-81f12f0e9a1a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:46.627109 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd2dc731-2b87-442b-88a3-81f12f0e9a1a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:46.627602 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd2dc731-2b87-442b-88a3-81f12f0e9a1a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:46.628038 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd2dc731-2b87-442b-88a3-81f12f0e9a1a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:46.628745 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd2dc731-2b87-442b-88a3-81f12f0e9a1a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:46.629231 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd2dc731-2b87-442b-88a3-81f12f0e9a1a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:46.629660 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bd2dc731-2b87-442b-88a3-81f12f0e9a1a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:46.634598 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d7e94eee-1549-4929-bed3-5153dee41cff tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:46.643240 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d7e94eee-1549-4929-bed3-5153dee41cff tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 200 len: 1327 microversion: 2.1 time: 0.117451 Oct 01 04:22:46.647092 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 302/575] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:46 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 1327 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:46.766699 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-bd2dc731-2b87-442b-88a3-81f12f0e9a1a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:46.775618 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-bd2dc731-2b87-442b-88a3-81f12f0e9a1a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:46.777104 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-bd2dc731-2b87-442b-88a3-81f12f0e9a1a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:46.778294 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bd2dc731-2b87-442b-88a3-81f12f0e9a1a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1601 microversion: 2.20 time: 0.163696 Oct 01 04:22:46.778871 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 274/576] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:22:46 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1601 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:22:46.804099 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4c6e1e1d-edb0-4209-b6d8-04d7cbea6c6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:46.804794 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4c6e1e1d-edb0-4209-b6d8-04d7cbea6c6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:46.811495 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c6e1e1d-edb0-4209-b6d8-04d7cbea6c6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:46.812051 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c6e1e1d-edb0-4209-b6d8-04d7cbea6c6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:46.812579 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c6e1e1d-edb0-4209-b6d8-04d7cbea6c6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:46.813381 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c6e1e1d-edb0-4209-b6d8-04d7cbea6c6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:46.813914 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c6e1e1d-edb0-4209-b6d8-04d7cbea6c6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:46.814447 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4c6e1e1d-edb0-4209-b6d8-04d7cbea6c6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:46.904949 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4c6e1e1d-edb0-4209-b6d8-04d7cbea6c6a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.104250 Oct 01 04:22:46.905866 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 303/577] 10.222.0.26 () {60 vars in 1316 bytes} [Sat Oct 1 04:22:46 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 04:22:47.667870 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3cd3f9b7-cc8d-40ef-9943-e5a8d3152768 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:47.669173 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3cd3f9b7-cc8d-40ef-9943-e5a8d3152768 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:47.675866 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cd3f9b7-cc8d-40ef-9943-e5a8d3152768 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:47.676694 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cd3f9b7-cc8d-40ef-9943-e5a8d3152768 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:47.677341 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cd3f9b7-cc8d-40ef-9943-e5a8d3152768 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:47.678053 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cd3f9b7-cc8d-40ef-9943-e5a8d3152768 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:47.678683 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cd3f9b7-cc8d-40ef-9943-e5a8d3152768 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:47.679251 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3cd3f9b7-cc8d-40ef-9943-e5a8d3152768 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:47.693830 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-3cd3f9b7-cc8d-40ef-9943-e5a8d3152768 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] HTTP exception thrown: Instance c2643a3f-906d-4cb4-8b4f-f2a63557ab69 could not be found. Oct 01 04:22:47.695522 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3cd3f9b7-cc8d-40ef-9943-e5a8d3152768 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Request method failure captured: Oct 01 04:22:47.695522 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 HTTP/1.1 Oct 01 04:22:47.695522 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept: application/json Oct 01 04:22:47.695522 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept-Encoding: identity Oct 01 04:22:47.695522 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Connection: close Oct 01 04:22:47.695522 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Length: 0 Oct 01 04:22:47.695522 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Type: application/json Oct 01 04:22:47.695522 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Host: 10.222.0.26 Oct 01 04:22:47.695522 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 01 04:22:47.695522 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 01 04:22:47.695522 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjN793DKBHUhC-8QdnYoBZGQnpA7Z6XZ0cXz6I00yXSRLWMK4sPzrqT-uvoxjgq718m7wHYzeTmJlBa5AQY06IF7N2cegWa6k9oAHMUQM7aCreRAFUUWl6tW7NhnlypA1LGn1wmWuHWdWqqQVRPKodN95UaXd0S8hRw2bWT-5aqn6kOOw Oct 01 04:22:47.695522 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Id: None Oct 01 04:22:47.695522 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Name: None Oct 01 04:22:47.695522 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 01 04:22:47.695522 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 01 04:22:47.695522 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 01 04:22:47.695522 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 01 04:22:47.695522 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Id: 16cd7bcb315d4dc58f73a9918adb57e2 Oct 01 04:22:47.695522 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Name: tempest-AttachVolumeTestJSON-20448997 Oct 01 04:22:47.695522 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Role: reader,member Oct 01 04:22:47.695522 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Roles: reader,member Oct 01 04:22:47.697121 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16cd7bcb315d4dc58f73a9918adb57e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16cd7bcb315d4dc58f73a9918adb57e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16cd7bcb315d4dc58f73a9918adb57e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16cd7bcb315d4dc58f73a9918adb57e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:22:47.697121 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant: tempest-AttachVolumeTestJSON-20448997 Oct 01 04:22:47.697121 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Id: 16cd7bcb315d4dc58f73a9918adb57e2 Oct 01 04:22:47.697121 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachVolumeTestJSON-20448997 Oct 01 04:22:47.697121 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User: tempest-AttachVolumeTestJSON-20448997-project Oct 01 04:22:47.697121 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 01 04:22:47.697121 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 01 04:22:47.697121 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Id: 3caf1cc366434d418c474d7a1879faa7 Oct 01 04:22:47.697121 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Name: tempest-AttachVolumeTestJSON-20448997-project Oct 01 04:22:47.697121 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: method: > Oct 01 04:22:47.697121 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: exception: Instance c2643a3f-906d-4cb4-8b4f-f2a63557ab69 could not be found. Oct 01 04:22:47.697121 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: action_args: {'id': 'c2643a3f-906d-4cb4-8b4f-f2a63557ab69'} Oct 01 04:22:47.698357 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:22:47.698357 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:22:47.698357 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:22:47.698357 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:22:47.698357 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:22:47.698357 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:22:47.698357 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:22:47.698357 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:22:47.698357 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:22:47.698357 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:22:47.698357 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2643a3f-906d-4cb4-8b4f-f2a63557ab69 could not be found. Oct 01 04:22:47.698357 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:22:47.698357 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:22:47.698357 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:22:47.698357 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:22:47.698357 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:22:47.698357 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:22:47.698357 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:22:47.698357 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:22:47.698357 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:22:47.699905 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:22:47.699905 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:22:47.699905 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:22:47.699905 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:22:47.699905 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:22:47.699905 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:22:47.699905 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:22:47.699905 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2643a3f-906d-4cb4-8b4f-f2a63557ab69 could not be found. Oct 01 04:22:47.699905 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:22:47.699905 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:22:47.699905 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:22:47.699905 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:22:47.699905 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:22:47.699905 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:22:47.699905 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:22:47.699905 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:22:47.699905 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2643a3f-906d-4cb4-8b4f-f2a63557ab69 could not be found. Oct 01 04:22:47.699905 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:22:47.701370 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3cd3f9b7-cc8d-40ef-9943-e5a8d3152768 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Returning 404 to user: Instance c2643a3f-906d-4cb4-8b4f-f2a63557ab69 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:22:47.701370 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3cd3f9b7-cc8d-40ef-9943-e5a8d3152768 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 404 len: 111 microversion: 2.1 time: 0.033919 Oct 01 04:22:47.701370 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 275/578] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:47 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:22:47.706882 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a8b259e4-3b60-4434-acdb-5b50a9fc04f3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '.version_select at 0x7fdfbe94eee0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:47.726150 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a8b259e4-3b60-4434-acdb-5b50a9fc04f3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2118104381" status: 202 len: 0 microversion: 2.1 time: 0.023424 Oct 01 04:22:47.727261 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 304/579] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 1 04:22:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2118104381 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 04:22:48.103056 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-17b28c99-a53c-42c8-b9d2-b99bd4231d70 req-3460062d-2f25-4a89-85ee-b13e9ca1824d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b21e7357-43a2-4dc9-b0f6-26b14b68c464", "tag": "735577aa-5ec2-48d4-8f41-38cb8f95250a"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:22:48.113710 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-17b28c99-a53c-42c8-b9d2-b99bd4231d70 req-3460062d-2f25-4a89-85ee-b13e9ca1824d service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:48.114197 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-17b28c99-a53c-42c8-b9d2-b99bd4231d70 req-3460062d-2f25-4a89-85ee-b13e9ca1824d service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:48.114630 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-17b28c99-a53c-42c8-b9d2-b99bd4231d70 req-3460062d-2f25-4a89-85ee-b13e9ca1824d service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:48.129438 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-17b28c99-a53c-42c8-b9d2-b99bd4231d70 req-3460062d-2f25-4a89-85ee-b13e9ca1824d service nova] Creating event network-changed:735577aa-5ec2-48d4-8f41-38cb8f95250a for instance b21e7357-43a2-4dc9-b0f6-26b14b68c464 on hv-cinder-86004 Oct 01 04:22:48.134371 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-17b28c99-a53c-42c8-b9d2-b99bd4231d70 req-3460062d-2f25-4a89-85ee-b13e9ca1824d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034881 Oct 01 04:22:48.134970 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 276/580] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:22:48.404899 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-59d2f490-a04a-4546-9025-62b5e253dc19 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Action: 'create', calling method: .version_select at 0x7fdfbe715940>, body: {"keypair": {"name": "tempest-keypair-1141803734", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3xk8HPieYiYb2hfolWJcPylmyogsjgkNen5DZ6HLMO1Sx8oZroM2iVBmyB6uT1nFJQnPkXI8afGMn7bzp5yKQ6Rc5ZTb+CoDfe17S0iHA6jW776x7xLL5w3Xo+YR7E2g=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:22:48.422199 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-59d2f490-a04a-4546-9025-62b5e253dc19 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Getting quotas for project 16cd7bcb315d4dc58f73a9918adb57e2. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:22:48.426437 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-59d2f490-a04a-4546-9025-62b5e253dc19 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Getting quotas for user 3caf1cc366434d418c474d7a1879faa7 and project 16cd7bcb315d4dc58f73a9918adb57e2. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:22:48.450615 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-59d2f490-a04a-4546-9025-62b5e253dc19 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049995 Oct 01 04:22:48.451889 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 305/581] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 1 04:22:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:22:49.842754 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-77706b8c-74a9-4895-b8c0-ae3f991147c7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1806514081", "imageRef": "c63d52d7-4e3d-40cf-a8b5-59a2d027d793", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3af0afc2-a8fa-427e-a8af-57c40105fd2b"}], "security_groups": [{"name": "tempest-securitygroup--1776402150"}], "key_name": "tempest-keypair-1141803734", "user_data": "}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:22:49.945357 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-77706b8c-74a9-4895-b8c0-ae3f991147c7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] validate_networks() for [('3af0afc2-a8fa-427e-a8af-57c40105fd2b', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 04:22:50.314065 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-77706b8c-74a9-4895-b8c0-ae3f991147c7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 04:22:50.314497 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-77706b8c-74a9-4895-b8c0-ae3f991147c7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 04:22:50.314979 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-77706b8c-74a9-4895-b8c0-ae3f991147c7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 04:22:50.315401 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-77706b8c-74a9-4895-b8c0-ae3f991147c7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 04:22:50.315824 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-77706b8c-74a9-4895-b8c0-ae3f991147c7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 04:22:50.324674 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77706b8c-74a9-4895-b8c0-ae3f991147c7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:50.325201 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77706b8c-74a9-4895-b8c0-ae3f991147c7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:50.325640 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77706b8c-74a9-4895-b8c0-ae3f991147c7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:50.326889 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77706b8c-74a9-4895-b8c0-ae3f991147c7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:50.327343 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77706b8c-74a9-4895-b8c0-ae3f991147c7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:50.327770 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-77706b8c-74a9-4895-b8c0-ae3f991147c7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:50.344711 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-77706b8c-74a9-4895-b8c0-ae3f991147c7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Getting quotas for project 16cd7bcb315d4dc58f73a9918adb57e2. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:22:50.348741 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-77706b8c-74a9-4895-b8c0-ae3f991147c7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Getting quotas for user 3caf1cc366434d418c474d7a1879faa7 and project 16cd7bcb315d4dc58f73a9918adb57e2. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:22:50.359782 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-77706b8c-74a9-4895-b8c0-ae3f991147c7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 04:22:50.362198 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-77706b8c-74a9-4895-b8c0-ae3f991147c7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c63d52d7-4e3d-40cf-a8b5-59a2d027d793',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 04:22:50.408938 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-77706b8c-74a9-4895-b8c0-ae3f991147c7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.571607 Oct 01 04:22:50.409609 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 277/582] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 1 04:22:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 04:22:50.421068 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f10de990-b167-42d4-b2c9-70e0f25986df tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:50.421782 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f10de990-b167-42d4-b2c9-70e0f25986df tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:50.476867 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f10de990-b167-42d4-b2c9-70e0f25986df tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:50.483840 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f10de990-b167-42d4-b2c9-70e0f25986df tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b" status: 200 len: 1238 microversion: 2.1 time: 0.066917 Oct 01 04:22:50.484404 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 306/583] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:50 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:51.506776 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a0dd07d8-1ce9-4eb0-a9c6-b76834186576 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:51.507383 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a0dd07d8-1ce9-4eb0-a9c6-b76834186576 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:51.513656 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0dd07d8-1ce9-4eb0-a9c6-b76834186576 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:51.514140 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0dd07d8-1ce9-4eb0-a9c6-b76834186576 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:51.514572 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0dd07d8-1ce9-4eb0-a9c6-b76834186576 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:51.515256 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0dd07d8-1ce9-4eb0-a9c6-b76834186576 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:51.515716 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0dd07d8-1ce9-4eb0-a9c6-b76834186576 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:51.516140 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a0dd07d8-1ce9-4eb0-a9c6-b76834186576 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:51.578540 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-a0dd07d8-1ce9-4eb0-a9c6-b76834186576 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:51.586105 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a0dd07d8-1ce9-4eb0-a9c6-b76834186576 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b" status: 200 len: 1234 microversion: 2.1 time: 0.083611 Oct 01 04:22:51.586716 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 278/584] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:51 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b => generated 1234 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:52.610245 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a8dcae34-a667-4799-88fc-4f2c65e204c3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:52.611006 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a8dcae34-a667-4799-88fc-4f2c65e204c3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:52.614006 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:52.619922 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8dcae34-a667-4799-88fc-4f2c65e204c3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:52.620415 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8dcae34-a667-4799-88fc-4f2c65e204c3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:52.620844 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8dcae34-a667-4799-88fc-4f2c65e204c3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:52.621567 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8dcae34-a667-4799-88fc-4f2c65e204c3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:52.622021 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8dcae34-a667-4799-88fc-4f2c65e204c3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:52.622472 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a8dcae34-a667-4799-88fc-4f2c65e204c3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:52.691284 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a8dcae34-a667-4799-88fc-4f2c65e204c3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:52.705204 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a8dcae34-a667-4799-88fc-4f2c65e204c3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b" status: 200 len: 1296 microversion: 2.1 time: 0.098932 Oct 01 04:22:52.706494 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 307/585] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:52 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b => generated 1296 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:53.639551 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-fdf8276c-22ab-405c-a254-9f7e82f2b089 req-ab3b6082-2ace-4756-b49c-d4d9502f8818 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe5ffc66-fce0-4d07-9190-6b4634a9047b", "tag": "b87ca074-d876-4fb1-9848-b40704e5a030"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:22:53.651866 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-fdf8276c-22ab-405c-a254-9f7e82f2b089 req-ab3b6082-2ace-4756-b49c-d4d9502f8818 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:53.652439 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-fdf8276c-22ab-405c-a254-9f7e82f2b089 req-ab3b6082-2ace-4756-b49c-d4d9502f8818 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:53.652964 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-fdf8276c-22ab-405c-a254-9f7e82f2b089 req-ab3b6082-2ace-4756-b49c-d4d9502f8818 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:53.665066 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-fdf8276c-22ab-405c-a254-9f7e82f2b089 req-ab3b6082-2ace-4756-b49c-d4d9502f8818 service nova] Creating event network-changed:b87ca074-d876-4fb1-9848-b40704e5a030 for instance fe5ffc66-fce0-4d07-9190-6b4634a9047b on hv-cinder-86004 Oct 01 04:22:53.670248 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-fdf8276c-22ab-405c-a254-9f7e82f2b089 req-ab3b6082-2ace-4756-b49c-d4d9502f8818 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034951 Oct 01 04:22:53.670890 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 279/586] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:22:53.729085 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-945bf43c-79d5-4f53-8223-df8a4f8a6f49 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:53.730434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-945bf43c-79d5-4f53-8223-df8a4f8a6f49 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:53.737100 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-945bf43c-79d5-4f53-8223-df8a4f8a6f49 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:53.737681 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-945bf43c-79d5-4f53-8223-df8a4f8a6f49 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:53.738143 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-945bf43c-79d5-4f53-8223-df8a4f8a6f49 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:53.738832 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-945bf43c-79d5-4f53-8223-df8a4f8a6f49 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:53.739298 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-945bf43c-79d5-4f53-8223-df8a4f8a6f49 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:53.739724 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-945bf43c-79d5-4f53-8223-df8a4f8a6f49 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:53.880533 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-945bf43c-79d5-4f53-8223-df8a4f8a6f49 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:53.888269 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-945bf43c-79d5-4f53-8223-df8a4f8a6f49 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b" status: 200 len: 1364 microversion: 2.1 time: 0.162984 Oct 01 04:22:53.888846 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 308/587] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:53 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:54.916166 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-584ede61-baf7-42dd-8edc-152f0e2832b1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1556824329"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:22:54.916814 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-52e2639e-e94e-4ed1-a997-ef1f632d01e5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:54.917206 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-584ede61-baf7-42dd-8edc-152f0e2832b1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:54.917415 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-52e2639e-e94e-4ed1-a997-ef1f632d01e5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:54.923238 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-584ede61-baf7-42dd-8edc-152f0e2832b1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:54.923730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-584ede61-baf7-42dd-8edc-152f0e2832b1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:54.924054 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52e2639e-e94e-4ed1-a997-ef1f632d01e5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:54.924360 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-584ede61-baf7-42dd-8edc-152f0e2832b1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:54.924564 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52e2639e-e94e-4ed1-a997-ef1f632d01e5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:54.925029 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52e2639e-e94e-4ed1-a997-ef1f632d01e5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:54.925188 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-584ede61-baf7-42dd-8edc-152f0e2832b1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:54.925652 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-584ede61-baf7-42dd-8edc-152f0e2832b1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:54.925822 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52e2639e-e94e-4ed1-a997-ef1f632d01e5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:54.926079 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-584ede61-baf7-42dd-8edc-152f0e2832b1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:54.926231 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52e2639e-e94e-4ed1-a997-ef1f632d01e5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:54.926588 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52e2639e-e94e-4ed1-a997-ef1f632d01e5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:55.134804 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.network.security_group_api [None req-584ede61-baf7-42dd-8edc-152f0e2832b1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Removing security group 2ca7254b-ab3b-4660-8166-5acecb5f522b from port a9fcf58b-9af0-47d5-9218-efddc535ddda Oct 01 04:22:55.140604 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-52e2639e-e94e-4ed1-a997-ef1f632d01e5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:55.143651 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:55.152848 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-52e2639e-e94e-4ed1-a997-ef1f632d01e5 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b" status: 200 len: 1364 microversion: 2.1 time: 0.242379 Oct 01 04:22:55.165026 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 280/588] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:54 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b => generated 1364 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:55.554857 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-584ede61-baf7-42dd-8edc-152f0e2832b1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "POST /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b/action" status: 202 len: 0 microversion: 2.1 time: 0.643090 Oct 01 04:22:55.555782 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 309/589] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 1 04:22:54 2022] POST /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b/action => generated 0 bytes in 645 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 04:22:55.571556 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-60b5bb1c-12b0-4edf-8122-b0f445dbb85e req-0ae1ec81-64ab-4700-a3a7-07fa9049647a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b9af495-cd51-4492-af9f-d43ba016007b", "tag": "a9fcf58b-9af0-47d5-9218-efddc535ddda"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:22:55.597125 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-60b5bb1c-12b0-4edf-8122-b0f445dbb85e req-0ae1ec81-64ab-4700-a3a7-07fa9049647a service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:55.597971 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-60b5bb1c-12b0-4edf-8122-b0f445dbb85e req-0ae1ec81-64ab-4700-a3a7-07fa9049647a service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:55.598924 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-60b5bb1c-12b0-4edf-8122-b0f445dbb85e req-0ae1ec81-64ab-4700-a3a7-07fa9049647a service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:55.617360 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-60b5bb1c-12b0-4edf-8122-b0f445dbb85e req-0ae1ec81-64ab-4700-a3a7-07fa9049647a service nova] Creating event network-changed:a9fcf58b-9af0-47d5-9218-efddc535ddda for instance 0b9af495-cd51-4492-af9f-d43ba016007b on hv-cinder-86004 Oct 01 04:22:55.628272 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-60b5bb1c-12b0-4edf-8122-b0f445dbb85e req-0ae1ec81-64ab-4700-a3a7-07fa9049647a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062013 Oct 01 04:22:55.631472 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 281/590] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:22:56.179870 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-73594868-10d1-44ff-ae00-b97425382cb4 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:56.180477 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-73594868-10d1-44ff-ae00-b97425382cb4 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:56.186674 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73594868-10d1-44ff-ae00-b97425382cb4 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:56.187159 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73594868-10d1-44ff-ae00-b97425382cb4 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:56.187590 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73594868-10d1-44ff-ae00-b97425382cb4 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:56.188468 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73594868-10d1-44ff-ae00-b97425382cb4 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:56.189127 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73594868-10d1-44ff-ae00-b97425382cb4 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:56.189631 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-73594868-10d1-44ff-ae00-b97425382cb4 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:56.372956 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-73594868-10d1-44ff-ae00-b97425382cb4 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:56.377787 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=100 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:22:56.394238 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-73594868-10d1-44ff-ae00-b97425382cb4 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b" status: 200 len: 1364 microversion: 2.1 time: 0.218568 Oct 01 04:22:56.406004 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 310/591] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:56 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b => generated 1364 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:22:57.029023 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1d69c517-35b0-4c10-a9d8-5108476782e4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:57.029613 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1d69c517-35b0-4c10-a9d8-5108476782e4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:57.036205 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d69c517-35b0-4c10-a9d8-5108476782e4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:57.036682 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d69c517-35b0-4c10-a9d8-5108476782e4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:57.037148 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d69c517-35b0-4c10-a9d8-5108476782e4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:57.037834 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d69c517-35b0-4c10-a9d8-5108476782e4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:57.038284 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d69c517-35b0-4c10-a9d8-5108476782e4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:57.038704 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1d69c517-35b0-4c10-a9d8-5108476782e4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:57.121195 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-1d69c517-35b0-4c10-a9d8-5108476782e4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lazy-loading 'services' on Instance uuid 0b9af495-cd51-4492-af9f-d43ba016007b {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:22:57.204562 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1d69c517-35b0-4c10-a9d8-5108476782e4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b/os-volume_attachments/6785570e-683c-4aa8-8e5f-644aae69585f" status: 202 len: 0 microversion: 2.1 time: 0.179615 Oct 01 04:22:57.205374 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 282/592] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 1 04:22:57 2022] DELETE /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b/os-volume_attachments/6785570e-683c-4aa8-8e5f-644aae69585f => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 04:22:57.214604 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f5d34dfd-1e72-4c88-9f78-fde5b98a984c tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:57.217285 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f5d34dfd-1e72-4c88-9f78-fde5b98a984c tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:57.228456 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5d34dfd-1e72-4c88-9f78-fde5b98a984c tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:57.229016 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5d34dfd-1e72-4c88-9f78-fde5b98a984c tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:57.229470 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5d34dfd-1e72-4c88-9f78-fde5b98a984c tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:57.230259 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5d34dfd-1e72-4c88-9f78-fde5b98a984c tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:57.231692 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5d34dfd-1e72-4c88-9f78-fde5b98a984c tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:57.232165 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5d34dfd-1e72-4c88-9f78-fde5b98a984c tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:57.267039 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f5d34dfd-1e72-4c88-9f78-fde5b98a984c tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056717 Oct 01 04:22:57.267626 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 311/593] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 1 04:22:57 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:22:57.419531 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7a006e15-657b-414f-a95c-d208accb4c7e tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:57.420785 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7a006e15-657b-414f-a95c-d208accb4c7e tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:57.428602 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a006e15-657b-414f-a95c-d208accb4c7e tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:57.429243 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a006e15-657b-414f-a95c-d208accb4c7e tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:57.429745 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a006e15-657b-414f-a95c-d208accb4c7e tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:57.430996 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a006e15-657b-414f-a95c-d208accb4c7e tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:57.431555 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a006e15-657b-414f-a95c-d208accb4c7e tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:57.432078 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7a006e15-657b-414f-a95c-d208accb4c7e tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:57.581762 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-7a006e15-657b-414f-a95c-d208accb4c7e tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:57.589457 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7a006e15-657b-414f-a95c-d208accb4c7e tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b" status: 200 len: 1364 microversion: 2.1 time: 0.174588 Oct 01 04:22:57.590048 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 283/594] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:57 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:57.652328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-8359027f-c566-4895-954c-e7d0807697c7 req-10292379-6fe3-4dc3-98c0-4d34171d74bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b9af495-cd51-4492-af9f-d43ba016007b", "tag": "a9fcf58b-9af0-47d5-9218-efddc535ddda"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:22:57.661589 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8359027f-c566-4895-954c-e7d0807697c7 req-10292379-6fe3-4dc3-98c0-4d34171d74bf service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:57.662072 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8359027f-c566-4895-954c-e7d0807697c7 req-10292379-6fe3-4dc3-98c0-4d34171d74bf service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:57.662498 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-8359027f-c566-4895-954c-e7d0807697c7 req-10292379-6fe3-4dc3-98c0-4d34171d74bf service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:57.673326 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-8359027f-c566-4895-954c-e7d0807697c7 req-10292379-6fe3-4dc3-98c0-4d34171d74bf service nova] Creating event network-changed:a9fcf58b-9af0-47d5-9218-efddc535ddda for instance 0b9af495-cd51-4492-af9f-d43ba016007b on hv-cinder-86004 Oct 01 04:22:57.679218 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-8359027f-c566-4895-954c-e7d0807697c7 req-10292379-6fe3-4dc3-98c0-4d34171d74bf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030361 Oct 01 04:22:57.679834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 312/595] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:22:58.279674 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ec51c520-368a-42b3-9e5c-b60e679a99d9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:58.282085 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ec51c520-368a-42b3-9e5c-b60e679a99d9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:58.289311 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ec51c520-368a-42b3-9e5c-b60e679a99d9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:58.289798 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ec51c520-368a-42b3-9e5c-b60e679a99d9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:58.290236 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ec51c520-368a-42b3-9e5c-b60e679a99d9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:58.290955 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ec51c520-368a-42b3-9e5c-b60e679a99d9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:58.291415 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ec51c520-368a-42b3-9e5c-b60e679a99d9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:58.292013 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ec51c520-368a-42b3-9e5c-b60e679a99d9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:58.321197 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ec51c520-368a-42b3-9e5c-b60e679a99d9 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045382 Oct 01 04:22:58.321749 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 284/596] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 1 04:22:58 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 04:22:58.334211 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-17cc7509-9457-4f96-a63d-d032d6e7dbc1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:58.334727 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-17cc7509-9457-4f96-a63d-d032d6e7dbc1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:58.340803 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17cc7509-9457-4f96-a63d-d032d6e7dbc1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:58.341328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17cc7509-9457-4f96-a63d-d032d6e7dbc1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:58.341767 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17cc7509-9457-4f96-a63d-d032d6e7dbc1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:58.342458 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17cc7509-9457-4f96-a63d-d032d6e7dbc1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:58.342913 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17cc7509-9457-4f96-a63d-d032d6e7dbc1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:58.343337 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-17cc7509-9457-4f96-a63d-d032d6e7dbc1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:58.573088 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-17cc7509-9457-4f96-a63d-d032d6e7dbc1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] HTTP exception thrown: Instance 0b9af495-cd51-4492-af9f-d43ba016007b is not attached to volume 6785570e-683c-4aa8-8e5f-644aae69585f Oct 01 04:22:58.582914 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-17cc7509-9457-4f96-a63d-d032d6e7dbc1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Request method failure captured: Oct 01 04:22:58.582914 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b/os-volume_attachments/6785570e-683c-4aa8-8e5f-644aae69585f HTTP/1.1 Oct 01 04:22:58.582914 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:22:58.582914 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:22:58.582914 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:22:58.582914 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 0 Oct 01 04:22:58.582914 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:22:58.582914 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:22:58.582914 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:22:58.582914 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:22:58.582914 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN7_onff81O28hXsgWzuJpFXefXLuVWsahIneNch9GAUpJ1hpLG1ZWW7WTsEURdX47BgcB4XyUi6O6A0xCwxzWjAQaxDhjuvBTADbMs0senh-MhsVTHnmdLXjuBOI9OQs2vAp5jVeJW1Mw7VS5AyP8-B1VmnS7y345yo0y9DvGRrTDTE Oct 01 04:22:58.582914 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:22:58.582914 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:22:58.582914 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:22:58.582914 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:22:58.582914 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:22:58.582914 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:22:58.582914 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: 1d29e2e750f948e1b0ccd4117c0d347a Oct 01 04:22:58.582914 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-TestMinimumBasicScenario-888564073 Oct 01 04:22:58.582914 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:22:58.582914 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:22:58.584553 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1d29e2e750f948e1b0ccd4117c0d347a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1d29e2e750f948e1b0ccd4117c0d347a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1d29e2e750f948e1b0ccd4117c0d347a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1d29e2e750f948e1b0ccd4117c0d347a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:22:58.584553 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-TestMinimumBasicScenario-888564073 Oct 01 04:22:58.584553 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 1d29e2e750f948e1b0ccd4117c0d347a Oct 01 04:22:58.584553 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestMinimumBasicScenario-888564073 Oct 01 04:22:58.584553 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-TestMinimumBasicScenario-888564073-project Oct 01 04:22:58.584553 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:22:58.584553 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:22:58.584553 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: 3d75f6b795064e00b20207e6cfc22cf1 Oct 01 04:22:58.584553 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-TestMinimumBasicScenario-888564073-project Oct 01 04:22:58.584553 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: > Oct 01 04:22:58.584553 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Instance 0b9af495-cd51-4492-af9f-d43ba016007b is not attached to volume 6785570e-683c-4aa8-8e5f-644aae69585f Oct 01 04:22:58.585510 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'server_id': '0b9af495-cd51-4492-af9f-d43ba016007b', 'id': '6785570e-683c-4aa8-8e5f-644aae69585f'} Oct 01 04:22:58.585510 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:22:58.585510 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:22:58.585510 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 01 04:22:58.585510 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 01 04:22:58.585510 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 01 04:22:58.585510 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 01 04:22:58.585510 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 01 04:22:58.585510 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 01 04:22:58.585510 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6785570e-683c-4aa8-8e5f-644aae69585f. Oct 01 04:22:58.585510 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:22:58.585510 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:22:58.585510 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:22:58.585510 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:22:58.585510 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:22:58.585510 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:22:58.585510 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:22:58.585510 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:22:58.585510 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:22:58.586895 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:22:58.586895 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 01 04:22:58.586895 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 01 04:22:58.586895 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b9af495-cd51-4492-af9f-d43ba016007b is not attached to volume 6785570e-683c-4aa8-8e5f-644aae69585f Oct 01 04:22:58.586895 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:22:58.586895 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:22:58.586895 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:22:58.586895 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:22:58.586895 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:22:58.586895 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:22:58.586895 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:22:58.586895 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:22:58.586895 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b9af495-cd51-4492-af9f-d43ba016007b is not attached to volume 6785570e-683c-4aa8-8e5f-644aae69585f Oct 01 04:22:58.586895 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:22:58.586895 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-17cc7509-9457-4f96-a63d-d032d6e7dbc1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Returning 404 to user: Instance 0b9af495-cd51-4492-af9f-d43ba016007b is not attached to volume 6785570e-683c-4aa8-8e5f-644aae69585f {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:22:58.588079 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-17cc7509-9457-4f96-a63d-d032d6e7dbc1 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b/os-volume_attachments/6785570e-683c-4aa8-8e5f-644aae69585f" status: 404 len: 154 microversion: 2.1 time: 0.255893 Oct 01 04:22:58.588079 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 313/597] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 1 04:22:58 2022] DELETE /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b/os-volume_attachments/6785570e-683c-4aa8-8e5f-644aae69585f => generated 154 bytes in 257 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:22:58.612207 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-764c74cd-786e-4e3b-8950-596dc6ed26fb tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:58.612838 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-764c74cd-786e-4e3b-8950-596dc6ed26fb tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:58.618725 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-764c74cd-786e-4e3b-8950-596dc6ed26fb tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:58.619209 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-764c74cd-786e-4e3b-8950-596dc6ed26fb tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:58.619634 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-764c74cd-786e-4e3b-8950-596dc6ed26fb tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:58.620330 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-764c74cd-786e-4e3b-8950-596dc6ed26fb tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:58.620786 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-764c74cd-786e-4e3b-8950-596dc6ed26fb tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:58.621232 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-764c74cd-786e-4e3b-8950-596dc6ed26fb tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:58.761711 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-764c74cd-786e-4e3b-8950-596dc6ed26fb tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:22:58.769252 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-764c74cd-786e-4e3b-8950-596dc6ed26fb tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b" status: 200 len: 1364 microversion: 2.1 time: 0.161555 Oct 01 04:22:58.769805 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 285/598] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:58 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:22:59.402683 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-d05e0ccb-39d1-41ba-88e8-8775f7ac9f97 req-f103e471-1a50-4002-8dec-5360aedcebaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe5ffc66-fce0-4d07-9190-6b4634a9047b", "name": "network-vif-plugged", "status": "completed", "tag": "b87ca074-d876-4fb1-9848-b40704e5a030"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:22:59.413344 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d05e0ccb-39d1-41ba-88e8-8775f7ac9f97 req-f103e471-1a50-4002-8dec-5360aedcebaf service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:59.413831 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d05e0ccb-39d1-41ba-88e8-8775f7ac9f97 req-f103e471-1a50-4002-8dec-5360aedcebaf service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:59.414256 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d05e0ccb-39d1-41ba-88e8-8775f7ac9f97 req-f103e471-1a50-4002-8dec-5360aedcebaf service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:59.425872 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-d05e0ccb-39d1-41ba-88e8-8775f7ac9f97 req-f103e471-1a50-4002-8dec-5360aedcebaf service nova] Creating event network-vif-plugged:b87ca074-d876-4fb1-9848-b40704e5a030 for instance fe5ffc66-fce0-4d07-9190-6b4634a9047b on hv-cinder-86004 Oct 01 04:22:59.430800 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-d05e0ccb-39d1-41ba-88e8-8775f7ac9f97 req-f103e471-1a50-4002-8dec-5360aedcebaf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032066 Oct 01 04:22:59.431392 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 314/599] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:22:59.732444 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bb8d77ea-6cea-4b0c-b73b-b9d31d918dad tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:59.732978 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bb8d77ea-6cea-4b0c-b73b-b9d31d918dad tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:59.740164 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb8d77ea-6cea-4b0c-b73b-b9d31d918dad tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:59.740650 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb8d77ea-6cea-4b0c-b73b-b9d31d918dad tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:59.741118 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb8d77ea-6cea-4b0c-b73b-b9d31d918dad tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:59.741810 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb8d77ea-6cea-4b0c-b73b-b9d31d918dad tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:59.742264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb8d77ea-6cea-4b0c-b73b-b9d31d918dad tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:59.742686 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb8d77ea-6cea-4b0c-b73b-b9d31d918dad tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:59.766825 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bb8d77ea-6cea-4b0c-b73b-b9d31d918dad tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 04:22:59.793979 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-872d0f53-6654-44cc-b128-4d5a014bfab7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:59.794809 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-872d0f53-6654-44cc-b128-4d5a014bfab7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:59.802556 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-872d0f53-6654-44cc-b128-4d5a014bfab7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:59.803290 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-872d0f53-6654-44cc-b128-4d5a014bfab7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:59.803797 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-872d0f53-6654-44cc-b128-4d5a014bfab7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:59.804617 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-872d0f53-6654-44cc-b128-4d5a014bfab7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:59.805109 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-872d0f53-6654-44cc-b128-4d5a014bfab7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:59.805541 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-872d0f53-6654-44cc-b128-4d5a014bfab7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:59.842033 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bb8d77ea-6cea-4b0c-b73b-b9d31d918dad tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 204 len: 0 microversion: 2.1 time: 0.113123 Oct 01 04:22:59.842625 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 286/600] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 1 04:22:59 2022] DELETE /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 04:22:59.851768 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-881f0e68-c264-45e2-a905-78ec1f30cf17 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:22:59.852473 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-881f0e68-c264-45e2-a905-78ec1f30cf17 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:22:59.858371 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-881f0e68-c264-45e2-a905-78ec1f30cf17 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:59.858859 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-881f0e68-c264-45e2-a905-78ec1f30cf17 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:59.859292 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-881f0e68-c264-45e2-a905-78ec1f30cf17 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:59.859990 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-881f0e68-c264-45e2-a905-78ec1f30cf17 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:22:59.860446 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-881f0e68-c264-45e2-a905-78ec1f30cf17 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:22:59.860868 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-881f0e68-c264-45e2-a905-78ec1f30cf17 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:22:59.998866 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-872d0f53-6654-44cc-b128-4d5a014bfab7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:00.006616 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-872d0f53-6654-44cc-b128-4d5a014bfab7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b" status: 200 len: 1364 microversion: 2.1 time: 0.216955 Oct 01 04:23:00.007406 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 315/601] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:59 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:23:00.028452 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-881f0e68-c264-45e2-a905-78ec1f30cf17 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:00.036996 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-881f0e68-c264-45e2-a905-78ec1f30cf17 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1553 microversion: 2.1 time: 0.189391 Oct 01 04:23:00.037560 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 287/602] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:22:59 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1553 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:23:01.031395 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:01.059434 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1c9c2ddd-13ab-4557-a02d-237f84011e13 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:01.060056 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1c9c2ddd-13ab-4557-a02d-237f84011e13 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:01.062087 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:01.062742 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:01.069695 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c9c2ddd-13ab-4557-a02d-237f84011e13 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:01.070194 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c9c2ddd-13ab-4557-a02d-237f84011e13 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:01.070635 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c9c2ddd-13ab-4557-a02d-237f84011e13 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:01.071338 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c9c2ddd-13ab-4557-a02d-237f84011e13 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:01.071800 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c9c2ddd-13ab-4557-a02d-237f84011e13 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:01.072230 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1c9c2ddd-13ab-4557-a02d-237f84011e13 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:01.085530 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-85fea02e-f441-4245-87de-e7d76816c4fe tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:01.086219 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-85fea02e-f441-4245-87de-e7d76816c4fe tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:01.092079 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85fea02e-f441-4245-87de-e7d76816c4fe tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:01.092651 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85fea02e-f441-4245-87de-e7d76816c4fe tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:01.093186 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85fea02e-f441-4245-87de-e7d76816c4fe tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:01.093872 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85fea02e-f441-4245-87de-e7d76816c4fe tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:01.094323 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85fea02e-f441-4245-87de-e7d76816c4fe tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:01.094744 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-85fea02e-f441-4245-87de-e7d76816c4fe tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:01.268667 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-1c9c2ddd-13ab-4557-a02d-237f84011e13 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:01.275130 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-85fea02e-f441-4245-87de-e7d76816c4fe tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:01.276593 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1c9c2ddd-13ab-4557-a02d-237f84011e13 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1553 microversion: 2.1 time: 0.220919 Oct 01 04:23:01.277203 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 288/603] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:01 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1553 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:23:01.283543 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-85fea02e-f441-4245-87de-e7d76816c4fe tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b" status: 200 len: 1364 microversion: 2.1 time: 0.256581 Oct 01 04:23:01.300660 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 316/604] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:01 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b => generated 1364 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:23:02.305415 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-18bd1666-b432-4499-9194-c9a8452f3e29 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:02.306029 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-18bd1666-b432-4499-9194-c9a8452f3e29 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:02.307400 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2413b7dc-fba4-4efa-a01d-33ba4e0586e1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:02.308013 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2413b7dc-fba4-4efa-a01d-33ba4e0586e1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:02.308268 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 04:23:02.308419 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Sat Oct 1 04:23:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b (ip 10.222.0.26) !!! Oct 01 04:23:02.310277 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 04:23:02.310404 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Sat Oct 1 04:23:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b (ip 10.222.0.26) !!! Oct 01 04:23:02.315953 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18bd1666-b432-4499-9194-c9a8452f3e29 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:02.316446 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18bd1666-b432-4499-9194-c9a8452f3e29 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:02.316883 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18bd1666-b432-4499-9194-c9a8452f3e29 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:02.317619 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18bd1666-b432-4499-9194-c9a8452f3e29 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:02.317846 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2413b7dc-fba4-4efa-a01d-33ba4e0586e1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:02.318078 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18bd1666-b432-4499-9194-c9a8452f3e29 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:02.318330 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2413b7dc-fba4-4efa-a01d-33ba4e0586e1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:02.318507 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-18bd1666-b432-4499-9194-c9a8452f3e29 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:02.318760 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2413b7dc-fba4-4efa-a01d-33ba4e0586e1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:02.319455 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2413b7dc-fba4-4efa-a01d-33ba4e0586e1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:02.319912 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2413b7dc-fba4-4efa-a01d-33ba4e0586e1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:02.320333 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2413b7dc-fba4-4efa-a01d-33ba4e0586e1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:02.513380 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2413b7dc-fba4-4efa-a01d-33ba4e0586e1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:02.517535 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-18bd1666-b432-4499-9194-c9a8452f3e29 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:02.521761 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2413b7dc-fba4-4efa-a01d-33ba4e0586e1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b" status: 200 len: 1364 microversion: 2.1 time: 0.218130 Oct 01 04:23:02.522866 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 317/605] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:02 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:23:02.525516 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-18bd1666-b432-4499-9194-c9a8452f3e29 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1553 microversion: 2.1 time: 0.223889 Oct 01 04:23:02.526081 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 289/606] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:02 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1553 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:23:02.989380 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-cdd451fc-0acb-43be-9af3-d91e09970f6c req-73be8363-bbc8-4b3a-a063-8667a6b31045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b9af495-cd51-4492-af9f-d43ba016007b", "name": "network-vif-deleted", "tag": "a9fcf58b-9af0-47d5-9218-efddc535ddda"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:23:02.999205 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-cdd451fc-0acb-43be-9af3-d91e09970f6c req-73be8363-bbc8-4b3a-a063-8667a6b31045 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:02.999620 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-cdd451fc-0acb-43be-9af3-d91e09970f6c req-73be8363-bbc8-4b3a-a063-8667a6b31045 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:03.000051 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-cdd451fc-0acb-43be-9af3-d91e09970f6c req-73be8363-bbc8-4b3a-a063-8667a6b31045 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:03.011922 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-cdd451fc-0acb-43be-9af3-d91e09970f6c req-73be8363-bbc8-4b3a-a063-8667a6b31045 service nova] Creating event network-vif-deleted:a9fcf58b-9af0-47d5-9218-efddc535ddda for instance 0b9af495-cd51-4492-af9f-d43ba016007b on hv-cinder-86004 Oct 01 04:23:03.016782 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-cdd451fc-0acb-43be-9af3-d91e09970f6c req-73be8363-bbc8-4b3a-a063-8667a6b31045 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031583 Oct 01 04:23:03.017948 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 318/607] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:23:03.545381 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e296802c-188f-4480-8246-af9a85823d2a tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:03.546631 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e296802c-188f-4480-8246-af9a85823d2a tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:03.549489 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:03.549633 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b4becb47-b9d5-4399-81be-467b9d046f0f tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:03.550569 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b4becb47-b9d5-4399-81be-467b9d046f0f tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:03.554990 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e296802c-188f-4480-8246-af9a85823d2a tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:03.555614 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e296802c-188f-4480-8246-af9a85823d2a tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:03.556059 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e296802c-188f-4480-8246-af9a85823d2a tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:03.556761 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e296802c-188f-4480-8246-af9a85823d2a tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:03.557258 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e296802c-188f-4480-8246-af9a85823d2a tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:03.557683 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e296802c-188f-4480-8246-af9a85823d2a tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:03.557894 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4becb47-b9d5-4399-81be-467b9d046f0f tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:03.558388 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4becb47-b9d5-4399-81be-467b9d046f0f tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:03.559560 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4becb47-b9d5-4399-81be-467b9d046f0f tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:03.560261 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4becb47-b9d5-4399-81be-467b9d046f0f tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:03.560724 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4becb47-b9d5-4399-81be-467b9d046f0f tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:03.562685 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4becb47-b9d5-4399-81be-467b9d046f0f tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:03.604265 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4becb47-b9d5-4399-81be-467b9d046f0f tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:03.604757 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4becb47-b9d5-4399-81be-467b9d046f0f tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:03.605437 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b4becb47-b9d5-4399-81be-467b9d046f0f tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:03.605898 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-b4becb47-b9d5-4399-81be-467b9d046f0f tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lazy-loading 'fault' on Instance uuid 0b9af495-cd51-4492-af9f-d43ba016007b {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:23:03.659281 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b4becb47-b9d5-4399-81be-467b9d046f0f tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d75f6b795064e00b20207e6cfc22cf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d29e2e750f948e1b0ccd4117c0d347a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:03.667252 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b4becb47-b9d5-4399-81be-467b9d046f0f tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 200 len: 1347 microversion: 2.1 time: 0.122706 Oct 01 04:23:03.668139 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 319/608] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:03 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 1347 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:23:03.719087 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-e296802c-188f-4480-8246-af9a85823d2a tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:03.727128 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e296802c-188f-4480-8246-af9a85823d2a tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b" status: 200 len: 1549 microversion: 2.1 time: 0.186138 Oct 01 04:23:03.727704 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 290/609] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:03 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b => generated 1549 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:23:03.750513 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e95e7a1c-49cd-448a-8dfb-22f8a92c989e tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:03.751069 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e95e7a1c-49cd-448a-8dfb-22f8a92c989e tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:03.759371 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e95e7a1c-49cd-448a-8dfb-22f8a92c989e tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:03.759854 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e95e7a1c-49cd-448a-8dfb-22f8a92c989e tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:03.760285 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e95e7a1c-49cd-448a-8dfb-22f8a92c989e tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:03.761000 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e95e7a1c-49cd-448a-8dfb-22f8a92c989e tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:03.761457 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e95e7a1c-49cd-448a-8dfb-22f8a92c989e tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:03.761875 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e95e7a1c-49cd-448a-8dfb-22f8a92c989e tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:03.842170 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e95e7a1c-49cd-448a-8dfb-22f8a92c989e tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095751 Oct 01 04:23:03.842910 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 320/610] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 1 04:23:03 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:23:04.691768 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8783d41a-61bb-4c25-8a0f-59a37645a2c4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:04.692425 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8783d41a-61bb-4c25-8a0f-59a37645a2c4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] [instance: 0b9af495-cd51-4492-af9f-d43ba016007b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:04.698827 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8783d41a-61bb-4c25-8a0f-59a37645a2c4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:04.699395 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8783d41a-61bb-4c25-8a0f-59a37645a2c4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:04.699862 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8783d41a-61bb-4c25-8a0f-59a37645a2c4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:04.700565 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8783d41a-61bb-4c25-8a0f-59a37645a2c4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:04.701048 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8783d41a-61bb-4c25-8a0f-59a37645a2c4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:04.701478 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8783d41a-61bb-4c25-8a0f-59a37645a2c4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:04.715958 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-8783d41a-61bb-4c25-8a0f-59a37645a2c4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] HTTP exception thrown: Instance 0b9af495-cd51-4492-af9f-d43ba016007b could not be found. Oct 01 04:23:04.717375 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8783d41a-61bb-4c25-8a0f-59a37645a2c4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Request method failure captured: Oct 01 04:23:04.717375 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b HTTP/1.1 Oct 01 04:23:04.717375 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept: application/json Oct 01 04:23:04.717375 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept-Encoding: identity Oct 01 04:23:04.717375 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Connection: close Oct 01 04:23:04.717375 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Length: 0 Oct 01 04:23:04.717375 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Type: application/json Oct 01 04:23:04.717375 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Host: 10.222.0.26 Oct 01 04:23:04.717375 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 01 04:23:04.717375 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 01 04:23:04.717375 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjN7_onff81O28hXsgWzuJpFXefXLuVWsahIneNch9GAUpJ1hpLG1ZWW7WTsEURdX47BgcB4XyUi6O6A0xCwxzWjAQaxDhjuvBTADbMs0senh-MhsVTHnmdLXjuBOI9OQs2vAp5jVeJW1Mw7VS5AyP8-B1VmnS7y345yo0y9DvGRrTDTE Oct 01 04:23:04.717375 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Id: None Oct 01 04:23:04.717375 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Name: None Oct 01 04:23:04.717375 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 01 04:23:04.717375 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 01 04:23:04.717375 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 01 04:23:04.717375 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 01 04:23:04.717375 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Id: 1d29e2e750f948e1b0ccd4117c0d347a Oct 01 04:23:04.717375 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Name: tempest-TestMinimumBasicScenario-888564073 Oct 01 04:23:04.717375 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Role: reader,member Oct 01 04:23:04.717375 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Roles: reader,member Oct 01 04:23:04.718873 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1d29e2e750f948e1b0ccd4117c0d347a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1d29e2e750f948e1b0ccd4117c0d347a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1d29e2e750f948e1b0ccd4117c0d347a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1d29e2e750f948e1b0ccd4117c0d347a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:23:04.718873 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant: tempest-TestMinimumBasicScenario-888564073 Oct 01 04:23:04.718873 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Id: 1d29e2e750f948e1b0ccd4117c0d347a Oct 01 04:23:04.718873 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Name: tempest-TestMinimumBasicScenario-888564073 Oct 01 04:23:04.718873 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User: tempest-TestMinimumBasicScenario-888564073-project Oct 01 04:23:04.718873 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 01 04:23:04.718873 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 01 04:23:04.718873 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Id: 3d75f6b795064e00b20207e6cfc22cf1 Oct 01 04:23:04.718873 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Name: tempest-TestMinimumBasicScenario-888564073-project Oct 01 04:23:04.718873 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: method: > Oct 01 04:23:04.718873 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: exception: Instance 0b9af495-cd51-4492-af9f-d43ba016007b could not be found. Oct 01 04:23:04.718873 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: action_args: {'id': '0b9af495-cd51-4492-af9f-d43ba016007b'} Oct 01 04:23:04.719734 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:23:04.719734 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:23:04.719734 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:23:04.719734 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:23:04.719734 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:23:04.719734 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:23:04.719734 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:23:04.719734 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:23:04.719734 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:23:04.719734 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:23:04.719734 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b9af495-cd51-4492-af9f-d43ba016007b could not be found. Oct 01 04:23:04.719734 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:23:04.719734 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:23:04.719734 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:23:04.719734 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:23:04.719734 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:23:04.719734 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:23:04.719734 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:23:04.719734 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:23:04.719734 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:23:04.721746 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:23:04.721746 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:23:04.721746 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:23:04.721746 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:23:04.721746 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:23:04.721746 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:23:04.721746 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:23:04.721746 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b9af495-cd51-4492-af9f-d43ba016007b could not be found. Oct 01 04:23:04.721746 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:23:04.721746 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:23:04.721746 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:23:04.721746 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:23:04.721746 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:23:04.721746 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:23:04.721746 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:23:04.721746 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:23:04.721746 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b9af495-cd51-4492-af9f-d43ba016007b could not be found. Oct 01 04:23:04.721746 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:23:04.726847 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8783d41a-61bb-4c25-8a0f-59a37645a2c4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Returning 404 to user: Instance 0b9af495-cd51-4492-af9f-d43ba016007b could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:23:04.726847 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8783d41a-61bb-4c25-8a0f-59a37645a2c4 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b" status: 404 len: 111 microversion: 2.1 time: 0.031104 Oct 01 04:23:04.726847 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 291/611] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:04 2022] GET /compute/v2.1/servers/0b9af495-cd51-4492-af9f-d43ba016007b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:23:04.735655 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4ff5be70-e679-4319-a96c-5c3d949653f7 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] Calling method '.version_select at 0x7fdfbe7d7af0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:04.756665 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4ff5be70-e679-4319-a96c-5c3d949653f7 tempest-TestMinimumBasicScenario-888564073 tempest-TestMinimumBasicScenario-888564073-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-593196368" status: 202 len: 0 microversion: 2.1 time: 0.031058 Oct 01 04:23:04.759799 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 321/612] 10.222.0.26 () {58 vars in 1269 bytes} [Sat Oct 1 04:23:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-593196368 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 04:23:04.764502 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-9cb429c4-3ea0-4ce1-b1f5-3e3e66caf319 req-db74c00c-36e0-4b4b-8fc7-8cbb9033a684 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe5ffc66-fce0-4d07-9190-6b4634a9047b", "tag": "b87ca074-d876-4fb1-9848-b40704e5a030"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:23:04.774677 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9cb429c4-3ea0-4ce1-b1f5-3e3e66caf319 req-db74c00c-36e0-4b4b-8fc7-8cbb9033a684 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:04.775200 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9cb429c4-3ea0-4ce1-b1f5-3e3e66caf319 req-db74c00c-36e0-4b4b-8fc7-8cbb9033a684 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:04.775632 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9cb429c4-3ea0-4ce1-b1f5-3e3e66caf319 req-db74c00c-36e0-4b4b-8fc7-8cbb9033a684 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:04.786739 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-9cb429c4-3ea0-4ce1-b1f5-3e3e66caf319 req-db74c00c-36e0-4b4b-8fc7-8cbb9033a684 service nova] Creating event network-changed:b87ca074-d876-4fb1-9848-b40704e5a030 for instance fe5ffc66-fce0-4d07-9190-6b4634a9047b on hv-cinder-86004 Oct 01 04:23:04.791562 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-9cb429c4-3ea0-4ce1-b1f5-3e3e66caf319 req-db74c00c-36e0-4b4b-8fc7-8cbb9033a684 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030593 Oct 01 04:23:04.792143 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 292/613] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:23:14.536766 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4f246ba9-6bb0-4fe5-82c9-36520bddcb33 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:14.537366 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4f246ba9-6bb0-4fe5-82c9-36520bddcb33 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:14.540057 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=48 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:14.545691 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f246ba9-6bb0-4fe5-82c9-36520bddcb33 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:14.546174 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f246ba9-6bb0-4fe5-82c9-36520bddcb33 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:14.546608 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f246ba9-6bb0-4fe5-82c9-36520bddcb33 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:14.547295 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f246ba9-6bb0-4fe5-82c9-36520bddcb33 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:14.547751 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f246ba9-6bb0-4fe5-82c9-36520bddcb33 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:14.548265 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4f246ba9-6bb0-4fe5-82c9-36520bddcb33 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:14.630470 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-4f246ba9-6bb0-4fe5-82c9-36520bddcb33 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lazy-loading 'services' on Instance uuid c6436bdc-2e17-43d4-a123-900e6269e551 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:23:14.753103 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4f246ba9-6bb0-4fe5-82c9-36520bddcb33 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551/os-volume_attachments/102b99cd-166f-4162-8578-a607b1c2f69f" status: 202 len: 0 microversion: 2.1 time: 0.220083 Oct 01 04:23:14.753688 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 322/614] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 1 04:23:14 2022] DELETE /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551/os-volume_attachments/102b99cd-166f-4162-8578-a607b1c2f69f => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 04:23:14.763660 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-30fba553-5a8a-4918-8542-96d7b373cca4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:14.766021 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-30fba553-5a8a-4918-8542-96d7b373cca4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:14.773960 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30fba553-5a8a-4918-8542-96d7b373cca4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:14.774549 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30fba553-5a8a-4918-8542-96d7b373cca4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:14.774987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30fba553-5a8a-4918-8542-96d7b373cca4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:14.775692 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30fba553-5a8a-4918-8542-96d7b373cca4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:14.776153 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30fba553-5a8a-4918-8542-96d7b373cca4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:14.776584 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-30fba553-5a8a-4918-8542-96d7b373cca4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:14.807417 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-30fba553-5a8a-4918-8542-96d7b373cca4 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049119 Oct 01 04:23:14.807973 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 293/615] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 1 04:23:14 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:23:15.822795 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ff49d390-0bf1-4be2-9270-171ebb0e224d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:15.825261 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ff49d390-0bf1-4be2-9270-171ebb0e224d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:15.831711 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff49d390-0bf1-4be2-9270-171ebb0e224d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:15.832201 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff49d390-0bf1-4be2-9270-171ebb0e224d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:15.832630 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff49d390-0bf1-4be2-9270-171ebb0e224d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:15.833357 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff49d390-0bf1-4be2-9270-171ebb0e224d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:15.833807 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff49d390-0bf1-4be2-9270-171ebb0e224d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:15.834225 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ff49d390-0bf1-4be2-9270-171ebb0e224d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:15.865290 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ff49d390-0bf1-4be2-9270-171ebb0e224d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047947 Oct 01 04:23:15.865830 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 323/616] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 1 04:23:15 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 04:23:15.944894 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f67f0b1d-b591-4bb5-92ef-b5f0292626ae tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:15.945496 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f67f0b1d-b591-4bb5-92ef-b5f0292626ae tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:15.951881 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f67f0b1d-b591-4bb5-92ef-b5f0292626ae tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:15.952393 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f67f0b1d-b591-4bb5-92ef-b5f0292626ae tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:15.952835 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f67f0b1d-b591-4bb5-92ef-b5f0292626ae tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:15.953554 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f67f0b1d-b591-4bb5-92ef-b5f0292626ae tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:15.954015 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f67f0b1d-b591-4bb5-92ef-b5f0292626ae tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:15.954445 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f67f0b1d-b591-4bb5-92ef-b5f0292626ae tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:15.978964 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f67f0b1d-b591-4bb5-92ef-b5f0292626ae tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 04:23:16.058133 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f67f0b1d-b591-4bb5-92ef-b5f0292626ae tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 204 len: 0 microversion: 2.1 time: 0.116869 Oct 01 04:23:16.058714 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 294/617] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 1 04:23:15 2022] DELETE /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 04:23:16.066950 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9306eb91-ee4d-4366-9a6b-4b02d3766042 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:16.067870 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9306eb91-ee4d-4366-9a6b-4b02d3766042 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:16.075091 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9306eb91-ee4d-4366-9a6b-4b02d3766042 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:16.075570 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9306eb91-ee4d-4366-9a6b-4b02d3766042 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:16.076002 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9306eb91-ee4d-4366-9a6b-4b02d3766042 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:16.076686 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9306eb91-ee4d-4366-9a6b-4b02d3766042 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:16.077168 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9306eb91-ee4d-4366-9a6b-4b02d3766042 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:16.077588 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9306eb91-ee4d-4366-9a6b-4b02d3766042 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:16.208470 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-9306eb91-ee4d-4366-9a6b-4b02d3766042 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:16.216187 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9306eb91-ee4d-4366-9a6b-4b02d3766042 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1690 microversion: 2.1 time: 0.153253 Oct 01 04:23:16.216760 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 324/618] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:16 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:23:17.241092 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c18bdab3-1d13-4c95-8866-bde4dbe3f74a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:17.241794 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c18bdab3-1d13-4c95-8866-bde4dbe3f74a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:17.248837 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c18bdab3-1d13-4c95-8866-bde4dbe3f74a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:17.249376 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c18bdab3-1d13-4c95-8866-bde4dbe3f74a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:17.249841 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c18bdab3-1d13-4c95-8866-bde4dbe3f74a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:17.250680 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c18bdab3-1d13-4c95-8866-bde4dbe3f74a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:17.251147 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c18bdab3-1d13-4c95-8866-bde4dbe3f74a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:17.252191 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c18bdab3-1d13-4c95-8866-bde4dbe3f74a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:17.267471 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:17.387613 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c18bdab3-1d13-4c95-8866-bde4dbe3f74a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:17.395315 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c18bdab3-1d13-4c95-8866-bde4dbe3f74a tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1690 microversion: 2.1 time: 0.159334 Oct 01 04:23:17.395874 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 295/619] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:17 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:23:18.418350 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0ca17772-4ba5-43fd-a104-aefe54658786 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:18.418955 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0ca17772-4ba5-43fd-a104-aefe54658786 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:18.425338 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ca17772-4ba5-43fd-a104-aefe54658786 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:18.426963 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ca17772-4ba5-43fd-a104-aefe54658786 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:18.427409 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ca17772-4ba5-43fd-a104-aefe54658786 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:18.428101 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ca17772-4ba5-43fd-a104-aefe54658786 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:18.428564 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ca17772-4ba5-43fd-a104-aefe54658786 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:18.429014 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0ca17772-4ba5-43fd-a104-aefe54658786 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:18.561024 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0ca17772-4ba5-43fd-a104-aefe54658786 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:18.568936 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0ca17772-4ba5-43fd-a104-aefe54658786 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1690 microversion: 2.1 time: 0.154398 Oct 01 04:23:18.569518 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 325/620] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:18 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:23:19.593846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-44281401-a8c0-47bf-8871-aa7a0e8eeea3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:19.594462 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-44281401-a8c0-47bf-8871-aa7a0e8eeea3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:19.601305 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-44281401-a8c0-47bf-8871-aa7a0e8eeea3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:19.601793 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-44281401-a8c0-47bf-8871-aa7a0e8eeea3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:19.602233 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-44281401-a8c0-47bf-8871-aa7a0e8eeea3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:19.602929 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-44281401-a8c0-47bf-8871-aa7a0e8eeea3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:19.603399 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-44281401-a8c0-47bf-8871-aa7a0e8eeea3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:19.603828 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-44281401-a8c0-47bf-8871-aa7a0e8eeea3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:19.740013 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-44281401-a8c0-47bf-8871-aa7a0e8eeea3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:19.748542 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-44281401-a8c0-47bf-8871-aa7a0e8eeea3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1690 microversion: 2.1 time: 0.158571 Oct 01 04:23:19.749148 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 296/621] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:19 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:23:20.624135 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-dbb1e58d-5684-40fa-834b-14c095d9ab16 req-d339f83b-7db2-4407-888f-01e1a79ea88b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6436bdc-2e17-43d4-a123-900e6269e551", "name": "network-vif-deleted", "tag": "2a43b463-65b3-423d-b16f-bcbd2964f478"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:23:20.634267 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-dbb1e58d-5684-40fa-834b-14c095d9ab16 req-d339f83b-7db2-4407-888f-01e1a79ea88b service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:20.634861 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-dbb1e58d-5684-40fa-834b-14c095d9ab16 req-d339f83b-7db2-4407-888f-01e1a79ea88b service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:20.635298 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-dbb1e58d-5684-40fa-834b-14c095d9ab16 req-d339f83b-7db2-4407-888f-01e1a79ea88b service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:20.648818 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-dbb1e58d-5684-40fa-834b-14c095d9ab16 req-d339f83b-7db2-4407-888f-01e1a79ea88b service nova] Creating event network-vif-deleted:2a43b463-65b3-423d-b16f-bcbd2964f478 for instance c6436bdc-2e17-43d4-a123-900e6269e551 on hv-cinder-86004 Oct 01 04:23:20.655421 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-dbb1e58d-5684-40fa-834b-14c095d9ab16 req-d339f83b-7db2-4407-888f-01e1a79ea88b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205748 Oct 01 04:23:20.660478 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 326/622] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:23:20.772542 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0df91030-40d1-46c7-9bbc-1f92906bfe94 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:20.773176 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0df91030-40d1-46c7-9bbc-1f92906bfe94 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:20.780544 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0df91030-40d1-46c7-9bbc-1f92906bfe94 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:20.781075 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0df91030-40d1-46c7-9bbc-1f92906bfe94 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:20.781519 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0df91030-40d1-46c7-9bbc-1f92906bfe94 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:20.782425 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0df91030-40d1-46c7-9bbc-1f92906bfe94 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:20.782887 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0df91030-40d1-46c7-9bbc-1f92906bfe94 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:20.783679 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0df91030-40d1-46c7-9bbc-1f92906bfe94 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:20.819807 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0df91030-40d1-46c7-9bbc-1f92906bfe94 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:20.820278 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0df91030-40d1-46c7-9bbc-1f92906bfe94 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:20.820723 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0df91030-40d1-46c7-9bbc-1f92906bfe94 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:20.821213 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-0df91030-40d1-46c7-9bbc-1f92906bfe94 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lazy-loading 'fault' on Instance uuid c6436bdc-2e17-43d4-a123-900e6269e551 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:23:20.865894 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-0df91030-40d1-46c7-9bbc-1f92906bfe94 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:20.873584 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0df91030-40d1-46c7-9bbc-1f92906bfe94 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 200 len: 1335 microversion: 2.1 time: 0.105880 Oct 01 04:23:20.874157 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 297/623] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:20 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 1335 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:23:21.896133 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-87f68fe8-c626-4014-bed1-9ff031c3fa75 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:21.897165 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-87f68fe8-c626-4014-bed1-9ff031c3fa75 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: c6436bdc-2e17-43d4-a123-900e6269e551] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:21.903810 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87f68fe8-c626-4014-bed1-9ff031c3fa75 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:21.904299 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87f68fe8-c626-4014-bed1-9ff031c3fa75 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:21.904742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87f68fe8-c626-4014-bed1-9ff031c3fa75 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:21.905478 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87f68fe8-c626-4014-bed1-9ff031c3fa75 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:21.905938 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87f68fe8-c626-4014-bed1-9ff031c3fa75 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:21.906365 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-87f68fe8-c626-4014-bed1-9ff031c3fa75 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:21.919706 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-87f68fe8-c626-4014-bed1-9ff031c3fa75 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] HTTP exception thrown: Instance c6436bdc-2e17-43d4-a123-900e6269e551 could not be found. Oct 01 04:23:21.921328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-87f68fe8-c626-4014-bed1-9ff031c3fa75 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Request method failure captured: Oct 01 04:23:21.921328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 HTTP/1.1 Oct 01 04:23:21.921328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:23:21.921328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:23:21.921328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:23:21.921328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 0 Oct 01 04:23:21.921328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:23:21.921328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:23:21.921328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:23:21.921328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:23:21.921328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN798A6ygEUFvvEkcfI7qSReKm2UxYzhCs2jYOOZOKUwCn2ocBNad4QsSD0Sc-uPRwf-i9kYKShvHWEgE5cSJRSUVxzLODzJsRfhomt7f51LXA4cAEZPLR8V-qxh0s5PTjrnOKdB2TN8W0JHxgE-z-knV9MsYBlFX3ZzUCq-ESRHWKW8 Oct 01 04:23:21.921328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:23:21.921328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:23:21.921328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:23:21.921328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:23:21.921328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:23:21.921328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:23:21.921328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: 839c91c5262a49768c3e937b5a034137 Oct 01 04:23:21.921328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-94604636 Oct 01 04:23:21.921328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:23:21.921328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:23:21.922953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_839c91c5262a49768c3e937b5a034137"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/839c91c5262a49768c3e937b5a034137"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/839c91c5262a49768c3e937b5a034137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/839c91c5262a49768c3e937b5a034137"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:23:21.922953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-ServerRescueNegativeTestJSON-94604636 Oct 01 04:23:21.922953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 839c91c5262a49768c3e937b5a034137 Oct 01 04:23:21.922953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-94604636 Oct 01 04:23:21.922953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-ServerRescueNegativeTestJSON-94604636-project Oct 01 04:23:21.922953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:23:21.922953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:23:21.922953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: 7014a1defd81461787318bc27d56b9aa Oct 01 04:23:21.922953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-ServerRescueNegativeTestJSON-94604636-project Oct 01 04:23:21.922953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: > Oct 01 04:23:21.922953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Instance c6436bdc-2e17-43d4-a123-900e6269e551 could not be found. Oct 01 04:23:21.922953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'id': 'c6436bdc-2e17-43d4-a123-900e6269e551'} Oct 01 04:23:21.923760 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:23:21.923760 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:23:21.923760 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:23:21.923760 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:23:21.923760 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:23:21.923760 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:23:21.923760 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:23:21.923760 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:23:21.923760 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:23:21.923760 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:23:21.923760 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6436bdc-2e17-43d4-a123-900e6269e551 could not be found. Oct 01 04:23:21.923760 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:23:21.923760 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:23:21.923760 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:23:21.923760 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:23:21.923760 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:23:21.923760 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:23:21.923760 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:23:21.923760 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:23:21.923760 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:23:21.925074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:23:21.925074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:23:21.925074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:23:21.925074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:23:21.925074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:23:21.925074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:23:21.925074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:23:21.925074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6436bdc-2e17-43d4-a123-900e6269e551 could not be found. Oct 01 04:23:21.925074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:23:21.925074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:23:21.925074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:23:21.925074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:23:21.925074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:23:21.925074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:23:21.925074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:23:21.925074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:23:21.925074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6436bdc-2e17-43d4-a123-900e6269e551 could not be found. Oct 01 04:23:21.925074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:23:21.926423 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-87f68fe8-c626-4014-bed1-9ff031c3fa75 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Returning 404 to user: Instance c6436bdc-2e17-43d4-a123-900e6269e551 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:23:21.926423 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-87f68fe8-c626-4014-bed1-9ff031c3fa75 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551" status: 404 len: 111 microversion: 2.1 time: 0.030817 Oct 01 04:23:21.926423 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 327/624] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:21 2022] GET /compute/v2.1/servers/c6436bdc-2e17-43d4-a123-900e6269e551 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:23:21.932231 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-28536936-a4d8-4c4a-b40a-b0bf4b6f44d3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '.version_select at 0x7fdfbe72be50>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:21.955640 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-28536936-a4d8-4c4a-b40a-b0bf4b6f44d3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1526214309" status: 202 len: 0 microversion: 2.1 time: 0.028062 Oct 01 04:23:21.956204 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 298/625] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 1 04:23:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1526214309 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 04:23:24.239056 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-70d0ab2f-2a66-473f-9a84-c076356f12a8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:24.239557 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-70d0ab2f-2a66-473f-9a84-c076356f12a8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:24.242284 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:24.247609 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70d0ab2f-2a66-473f-9a84-c076356f12a8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:24.248094 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70d0ab2f-2a66-473f-9a84-c076356f12a8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:24.248532 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70d0ab2f-2a66-473f-9a84-c076356f12a8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:24.249250 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70d0ab2f-2a66-473f-9a84-c076356f12a8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:24.249705 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70d0ab2f-2a66-473f-9a84-c076356f12a8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:24.250131 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-70d0ab2f-2a66-473f-9a84-c076356f12a8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:24.275196 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-70d0ab2f-2a66-473f-9a84-c076356f12a8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464/ips" status: 200 len: 152 microversion: 2.20 time: 0.145176 Oct 01 04:23:24.275741 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 328/626] 10.222.0.26 () {60 vars in 1289 bytes} [Sat Oct 1 04:23:24 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464/ips => generated 152 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 04:23:24.809517 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-60e2c111-d12c-46b8-ad65-b38bc4957c7f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:24.810066 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-60e2c111-d12c-46b8-ad65-b38bc4957c7f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:24.816164 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60e2c111-d12c-46b8-ad65-b38bc4957c7f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:24.816656 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60e2c111-d12c-46b8-ad65-b38bc4957c7f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:24.817135 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60e2c111-d12c-46b8-ad65-b38bc4957c7f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:24.818026 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60e2c111-d12c-46b8-ad65-b38bc4957c7f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:24.818687 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60e2c111-d12c-46b8-ad65-b38bc4957c7f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:24.819070 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-60e2c111-d12c-46b8-ad65-b38bc4957c7f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:24.844312 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-60e2c111-d12c-46b8-ad65-b38bc4957c7f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 04:23:24.918372 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-60e2c111-d12c-46b8-ad65-b38bc4957c7f tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 204 len: 0 microversion: 2.1 time: 0.113366 Oct 01 04:23:24.918948 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 299/627] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 1 04:23:24 2022] DELETE /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 04:23:24.927241 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-88379aff-df11-49bc-85db-cf9e7052c5c6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:24.928811 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-88379aff-df11-49bc-85db-cf9e7052c5c6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:24.936226 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88379aff-df11-49bc-85db-cf9e7052c5c6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:24.936708 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88379aff-df11-49bc-85db-cf9e7052c5c6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:24.937280 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88379aff-df11-49bc-85db-cf9e7052c5c6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:24.938442 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88379aff-df11-49bc-85db-cf9e7052c5c6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:24.939070 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88379aff-df11-49bc-85db-cf9e7052c5c6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:24.939551 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88379aff-df11-49bc-85db-cf9e7052c5c6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:25.073230 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-88379aff-df11-49bc-85db-cf9e7052c5c6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:25.080970 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-88379aff-df11-49bc-85db-cf9e7052c5c6 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1509 microversion: 2.1 time: 0.157979 Oct 01 04:23:25.081544 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 329/628] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:24 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:23:26.105465 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e09758c8-3239-4457-bcab-7cd96b85b7c3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:26.106165 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e09758c8-3239-4457-bcab-7cd96b85b7c3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:26.112484 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e09758c8-3239-4457-bcab-7cd96b85b7c3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:26.112986 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e09758c8-3239-4457-bcab-7cd96b85b7c3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:26.113422 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e09758c8-3239-4457-bcab-7cd96b85b7c3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:26.114107 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e09758c8-3239-4457-bcab-7cd96b85b7c3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:26.114562 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e09758c8-3239-4457-bcab-7cd96b85b7c3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:26.114981 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e09758c8-3239-4457-bcab-7cd96b85b7c3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:26.247333 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-e09758c8-3239-4457-bcab-7cd96b85b7c3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:26.254988 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e09758c8-3239-4457-bcab-7cd96b85b7c3 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1509 microversion: 2.1 time: 0.153819 Oct 01 04:23:26.255557 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 300/629] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:26 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:23:26.771239 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dd24743d-0b40-444a-a986-dc345b65175b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:23:26.772254 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dd24743d-0b40-444a-a986-dc345b65175b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:26.778822 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd24743d-0b40-444a-a986-dc345b65175b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:26.779300 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd24743d-0b40-444a-a986-dc345b65175b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:26.779730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd24743d-0b40-444a-a986-dc345b65175b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:26.780411 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd24743d-0b40-444a-a986-dc345b65175b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:26.780858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd24743d-0b40-444a-a986-dc345b65175b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:26.781306 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dd24743d-0b40-444a-a986-dc345b65175b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:26.804265 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-dd24743d-0b40-444a-a986-dc345b65175b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lazy-loading 'flavor' on Instance uuid b21e7357-43a2-4dc9-b0f6-26b14b68c464 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:23:26.991896 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dd24743d-0b40-444a-a986-dc345b65175b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "POST /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464/action" status: 202 len: 0 microversion: 2.20 time: 0.224602 Oct 01 04:23:26.992452 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 330/630] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 1 04:23:26 2022] POST /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 01 04:23:27.000581 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f4d4f14c-f181-4977-9ac6-d85619763f53 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:27.001354 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f4d4f14c-f181-4977-9ac6-d85619763f53 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:27.007908 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4d4f14c-f181-4977-9ac6-d85619763f53 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:27.008432 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4d4f14c-f181-4977-9ac6-d85619763f53 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:27.008875 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4d4f14c-f181-4977-9ac6-d85619763f53 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:27.009599 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4d4f14c-f181-4977-9ac6-d85619763f53 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:27.010064 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4d4f14c-f181-4977-9ac6-d85619763f53 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:27.010493 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4d4f14c-f181-4977-9ac6-d85619763f53 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:27.150999 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-f4d4f14c-f181-4977-9ac6-d85619763f53 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:27.159273 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-f4d4f14c-f181-4977-9ac6-d85619763f53 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:27.161242 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-f4d4f14c-f181-4977-9ac6-d85619763f53 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:27.163167 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f4d4f14c-f181-4977-9ac6-d85619763f53 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1725 microversion: 2.20 time: 0.165970 Oct 01 04:23:27.163751 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 301/631] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:23:26 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:23:27.278820 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c31420c0-ad62-419f-89f6-0c2b1d1f5708 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:27.279553 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c31420c0-ad62-419f-89f6-0c2b1d1f5708 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:27.285759 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c31420c0-ad62-419f-89f6-0c2b1d1f5708 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:27.286248 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c31420c0-ad62-419f-89f6-0c2b1d1f5708 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:27.286687 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c31420c0-ad62-419f-89f6-0c2b1d1f5708 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:27.287907 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c31420c0-ad62-419f-89f6-0c2b1d1f5708 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:27.288572 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c31420c0-ad62-419f-89f6-0c2b1d1f5708 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:27.289049 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c31420c0-ad62-419f-89f6-0c2b1d1f5708 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:27.419257 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c31420c0-ad62-419f-89f6-0c2b1d1f5708 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:27.426863 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c31420c0-ad62-419f-89f6-0c2b1d1f5708 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1509 microversion: 2.1 time: 0.152320 Oct 01 04:23:27.427424 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 331/632] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:27 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:23:27.993022 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-4934c91a-6371-4baa-8416-d33abc6ce8e9 req-e9e4914e-8209-49de-ac6d-708fc87965c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f161c249-ba0f-42c9-a1f0-8c7913b666f9", "name": "network-vif-deleted", "tag": "94c6e2ab-bf5f-4d4a-87aa-757bce04cc43"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:23:28.002952 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4934c91a-6371-4baa-8416-d33abc6ce8e9 req-e9e4914e-8209-49de-ac6d-708fc87965c1 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:28.003222 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4934c91a-6371-4baa-8416-d33abc6ce8e9 req-e9e4914e-8209-49de-ac6d-708fc87965c1 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:28.003658 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-4934c91a-6371-4baa-8416-d33abc6ce8e9 req-e9e4914e-8209-49de-ac6d-708fc87965c1 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:28.016665 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-4934c91a-6371-4baa-8416-d33abc6ce8e9 req-e9e4914e-8209-49de-ac6d-708fc87965c1 service nova] Creating event network-vif-deleted:94c6e2ab-bf5f-4d4a-87aa-757bce04cc43 for instance f161c249-ba0f-42c9-a1f0-8c7913b666f9 on hv-cinder-86004 Oct 01 04:23:28.022555 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-4934c91a-6371-4baa-8416-d33abc6ce8e9 req-e9e4914e-8209-49de-ac6d-708fc87965c1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033163 Oct 01 04:23:28.023540 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 302/633] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:23:28.189012 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1239e603-184f-4db4-af58-7eb173164a4b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:28.189689 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1239e603-184f-4db4-af58-7eb173164a4b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:28.196372 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1239e603-184f-4db4-af58-7eb173164a4b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:28.196779 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1239e603-184f-4db4-af58-7eb173164a4b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:28.197237 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1239e603-184f-4db4-af58-7eb173164a4b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:28.197939 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1239e603-184f-4db4-af58-7eb173164a4b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:28.198393 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1239e603-184f-4db4-af58-7eb173164a4b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:28.198820 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1239e603-184f-4db4-af58-7eb173164a4b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:28.338307 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1239e603-184f-4db4-af58-7eb173164a4b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:28.346548 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1239e603-184f-4db4-af58-7eb173164a4b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:28.348003 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1239e603-184f-4db4-af58-7eb173164a4b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:28.351128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1239e603-184f-4db4-af58-7eb173164a4b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1725 microversion: 2.20 time: 0.165150 Oct 01 04:23:28.351713 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 332/634] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:23:28 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:23:28.450828 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-096b5c3d-60b6-4556-9871-301ec8755981 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:28.451561 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-096b5c3d-60b6-4556-9871-301ec8755981 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:28.457717 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-096b5c3d-60b6-4556-9871-301ec8755981 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:28.458191 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-096b5c3d-60b6-4556-9871-301ec8755981 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:28.458629 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-096b5c3d-60b6-4556-9871-301ec8755981 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:28.460038 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-096b5c3d-60b6-4556-9871-301ec8755981 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:28.460504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-096b5c3d-60b6-4556-9871-301ec8755981 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:28.460958 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-096b5c3d-60b6-4556-9871-301ec8755981 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:28.492155 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-096b5c3d-60b6-4556-9871-301ec8755981 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:28.492668 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-096b5c3d-60b6-4556-9871-301ec8755981 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:28.493149 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-096b5c3d-60b6-4556-9871-301ec8755981 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:28.493602 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-096b5c3d-60b6-4556-9871-301ec8755981 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lazy-loading 'fault' on Instance uuid f161c249-ba0f-42c9-a1f0-8c7913b666f9 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:23:28.537024 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-096b5c3d-60b6-4556-9871-301ec8755981 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:28.545429 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-096b5c3d-60b6-4556-9871-301ec8755981 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 200 len: 1312 microversion: 2.1 time: 0.099270 Oct 01 04:23:28.545995 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 303/635] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:28 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:23:29.376449 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c33821ff-641a-465f-861e-6e65bb527c22 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:29.377118 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c33821ff-641a-465f-861e-6e65bb527c22 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:29.384106 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c33821ff-641a-465f-861e-6e65bb527c22 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:29.384589 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c33821ff-641a-465f-861e-6e65bb527c22 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:29.385096 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c33821ff-641a-465f-861e-6e65bb527c22 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:29.385785 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c33821ff-641a-465f-861e-6e65bb527c22 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:29.386238 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c33821ff-641a-465f-861e-6e65bb527c22 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:29.386662 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c33821ff-641a-465f-861e-6e65bb527c22 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:29.517385 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c33821ff-641a-465f-861e-6e65bb527c22 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:29.528672 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c33821ff-641a-465f-861e-6e65bb527c22 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:29.530215 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c33821ff-641a-465f-861e-6e65bb527c22 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:29.531502 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c33821ff-641a-465f-861e-6e65bb527c22 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1725 microversion: 2.20 time: 0.158897 Oct 01 04:23:29.532056 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 333/636] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:23:29 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:23:29.567637 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3b0f85ea-2650-4e74-977e-2ac914f76aec tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:29.568284 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3b0f85ea-2650-4e74-977e-2ac914f76aec tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: f161c249-ba0f-42c9-a1f0-8c7913b666f9] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:29.575139 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b0f85ea-2650-4e74-977e-2ac914f76aec tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:29.575620 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b0f85ea-2650-4e74-977e-2ac914f76aec tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:29.576060 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b0f85ea-2650-4e74-977e-2ac914f76aec tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:29.576749 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b0f85ea-2650-4e74-977e-2ac914f76aec tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:29.577247 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b0f85ea-2650-4e74-977e-2ac914f76aec tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:29.577676 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b0f85ea-2650-4e74-977e-2ac914f76aec tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:29.593648 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-3b0f85ea-2650-4e74-977e-2ac914f76aec tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] HTTP exception thrown: Instance f161c249-ba0f-42c9-a1f0-8c7913b666f9 could not be found. Oct 01 04:23:29.595268 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3b0f85ea-2650-4e74-977e-2ac914f76aec tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Request method failure captured: Oct 01 04:23:29.595268 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 HTTP/1.1 Oct 01 04:23:29.595268 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept: application/json Oct 01 04:23:29.595268 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept-Encoding: identity Oct 01 04:23:29.595268 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Connection: close Oct 01 04:23:29.595268 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Length: 0 Oct 01 04:23:29.595268 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Type: application/json Oct 01 04:23:29.595268 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Host: 10.222.0.26 Oct 01 04:23:29.595268 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 01 04:23:29.595268 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 01 04:23:29.595268 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjN798A6ygEUFvvEkcfI7qSReKm2UxYzhCs2jYOOZOKUwCn2ocBNad4QsSD0Sc-uPRwf-i9kYKShvHWEgE5cSJRSUVxzLODzJsRfhomt7f51LXA4cAEZPLR8V-qxh0s5PTjrnOKdB2TN8W0JHxgE-z-knV9MsYBlFX3ZzUCq-ESRHWKW8 Oct 01 04:23:29.595268 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Id: None Oct 01 04:23:29.595268 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Name: None Oct 01 04:23:29.595268 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 01 04:23:29.595268 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 01 04:23:29.595268 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 01 04:23:29.595268 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 01 04:23:29.595268 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Id: 839c91c5262a49768c3e937b5a034137 Oct 01 04:23:29.595268 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-94604636 Oct 01 04:23:29.595268 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Role: reader,member Oct 01 04:23:29.595268 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Roles: reader,member Oct 01 04:23:29.596848 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_839c91c5262a49768c3e937b5a034137"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/839c91c5262a49768c3e937b5a034137"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/839c91c5262a49768c3e937b5a034137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/839c91c5262a49768c3e937b5a034137"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:23:29.596848 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant: tempest-ServerRescueNegativeTestJSON-94604636 Oct 01 04:23:29.596848 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Id: 839c91c5262a49768c3e937b5a034137 Oct 01 04:23:29.596848 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-94604636 Oct 01 04:23:29.596848 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User: tempest-ServerRescueNegativeTestJSON-94604636-project Oct 01 04:23:29.596848 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 01 04:23:29.596848 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 01 04:23:29.596848 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Id: 7014a1defd81461787318bc27d56b9aa Oct 01 04:23:29.596848 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Name: tempest-ServerRescueNegativeTestJSON-94604636-project Oct 01 04:23:29.596848 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: method: > Oct 01 04:23:29.596848 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: exception: Instance f161c249-ba0f-42c9-a1f0-8c7913b666f9 could not be found. Oct 01 04:23:29.596848 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: action_args: {'id': 'f161c249-ba0f-42c9-a1f0-8c7913b666f9'} Oct 01 04:23:29.597878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:23:29.597878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:23:29.597878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:23:29.597878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:23:29.597878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:23:29.597878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:23:29.597878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:23:29.597878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:23:29.597878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:23:29.597878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:23:29.597878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f161c249-ba0f-42c9-a1f0-8c7913b666f9 could not be found. Oct 01 04:23:29.597878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:23:29.597878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:23:29.597878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:23:29.597878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:23:29.597878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:23:29.597878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:23:29.597878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:23:29.597878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:23:29.597878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:23:29.599417 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:23:29.599417 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:23:29.599417 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:23:29.599417 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:23:29.599417 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:23:29.599417 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:23:29.599417 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:23:29.599417 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f161c249-ba0f-42c9-a1f0-8c7913b666f9 could not be found. Oct 01 04:23:29.599417 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:23:29.599417 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:23:29.599417 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:23:29.599417 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:23:29.599417 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:23:29.599417 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:23:29.599417 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:23:29.599417 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:23:29.599417 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f161c249-ba0f-42c9-a1f0-8c7913b666f9 could not be found. Oct 01 04:23:29.599417 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:23:29.601642 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3b0f85ea-2650-4e74-977e-2ac914f76aec tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Returning 404 to user: Instance f161c249-ba0f-42c9-a1f0-8c7913b666f9 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:23:29.601642 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3b0f85ea-2650-4e74-977e-2ac914f76aec tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9" status: 404 len: 111 microversion: 2.1 time: 0.033067 Oct 01 04:23:29.601642 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 304/637] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:29 2022] GET /compute/v2.1/servers/f161c249-ba0f-42c9-a1f0-8c7913b666f9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:23:29.606311 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3278d352-4c32-4d7b-8e47-fc6e5f11727d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:29.606814 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3278d352-4c32-4d7b-8e47-fc6e5f11727d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:29.612717 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3278d352-4c32-4d7b-8e47-fc6e5f11727d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:29.613239 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3278d352-4c32-4d7b-8e47-fc6e5f11727d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:29.613684 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3278d352-4c32-4d7b-8e47-fc6e5f11727d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:29.614381 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3278d352-4c32-4d7b-8e47-fc6e5f11727d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:29.614841 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3278d352-4c32-4d7b-8e47-fc6e5f11727d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:29.615281 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3278d352-4c32-4d7b-8e47-fc6e5f11727d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:29.640716 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3278d352-4c32-4d7b-8e47-fc6e5f11727d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 04:23:29.715705 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3278d352-4c32-4d7b-8e47-fc6e5f11727d tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a" status: 204 len: 0 microversion: 2.1 time: 0.112829 Oct 01 04:23:29.716595 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 334/638] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 1 04:23:29 2022] DELETE /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 04:23:29.726391 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d3adabe2-6f12-4195-973b-b65da13795bb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:29.727040 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d3adabe2-6f12-4195-973b-b65da13795bb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:29.732874 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3adabe2-6f12-4195-973b-b65da13795bb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:29.733392 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3adabe2-6f12-4195-973b-b65da13795bb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:29.733830 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3adabe2-6f12-4195-973b-b65da13795bb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:29.734522 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3adabe2-6f12-4195-973b-b65da13795bb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:29.734984 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3adabe2-6f12-4195-973b-b65da13795bb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:29.735416 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d3adabe2-6f12-4195-973b-b65da13795bb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:29.862690 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-d3adabe2-6f12-4195-973b-b65da13795bb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:29.870585 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d3adabe2-6f12-4195-973b-b65da13795bb tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a" status: 200 len: 1522 microversion: 2.1 time: 0.149159 Oct 01 04:23:29.871152 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 305/639] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:29 2022] GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:23:30.557596 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-145c8a8c-6ae3-4ff9-a5a9-97e555ad8360 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:30.558302 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-145c8a8c-6ae3-4ff9-a5a9-97e555ad8360 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:30.564635 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-145c8a8c-6ae3-4ff9-a5a9-97e555ad8360 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:30.565167 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-145c8a8c-6ae3-4ff9-a5a9-97e555ad8360 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:30.565606 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-145c8a8c-6ae3-4ff9-a5a9-97e555ad8360 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:30.566302 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-145c8a8c-6ae3-4ff9-a5a9-97e555ad8360 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:30.566761 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-145c8a8c-6ae3-4ff9-a5a9-97e555ad8360 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:30.567192 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-145c8a8c-6ae3-4ff9-a5a9-97e555ad8360 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:30.701001 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-145c8a8c-6ae3-4ff9-a5a9-97e555ad8360 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:30.704520 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:30.710657 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-145c8a8c-6ae3-4ff9-a5a9-97e555ad8360 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:30.712110 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-145c8a8c-6ae3-4ff9-a5a9-97e555ad8360 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:30.713298 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-145c8a8c-6ae3-4ff9-a5a9-97e555ad8360 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1725 microversion: 2.20 time: 0.159975 Oct 01 04:23:30.713863 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 335/640] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:23:30 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:23:30.893686 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-998685e6-a8d5-4a22-8d0b-39471ca47017 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:30.894323 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-998685e6-a8d5-4a22-8d0b-39471ca47017 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:30.901602 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-998685e6-a8d5-4a22-8d0b-39471ca47017 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:30.902084 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-998685e6-a8d5-4a22-8d0b-39471ca47017 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:30.902514 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-998685e6-a8d5-4a22-8d0b-39471ca47017 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:30.903298 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-998685e6-a8d5-4a22-8d0b-39471ca47017 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:30.903844 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-998685e6-a8d5-4a22-8d0b-39471ca47017 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:30.904270 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-998685e6-a8d5-4a22-8d0b-39471ca47017 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:31.036519 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-998685e6-a8d5-4a22-8d0b-39471ca47017 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:31.044617 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-998685e6-a8d5-4a22-8d0b-39471ca47017 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a" status: 200 len: 1522 microversion: 2.1 time: 0.155127 Oct 01 04:23:31.045207 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 306/641] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:30 2022] GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:23:31.739490 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b9bf6257-b629-455f-b5e5-a6cdfe2d1d6c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:31.740096 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b9bf6257-b629-455f-b5e5-a6cdfe2d1d6c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:31.748034 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9bf6257-b629-455f-b5e5-a6cdfe2d1d6c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:31.748495 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9bf6257-b629-455f-b5e5-a6cdfe2d1d6c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:31.748953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9bf6257-b629-455f-b5e5-a6cdfe2d1d6c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:31.749641 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9bf6257-b629-455f-b5e5-a6cdfe2d1d6c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:31.750101 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9bf6257-b629-455f-b5e5-a6cdfe2d1d6c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:31.750527 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b9bf6257-b629-455f-b5e5-a6cdfe2d1d6c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:31.876391 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b9bf6257-b629-455f-b5e5-a6cdfe2d1d6c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:31.884965 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b9bf6257-b629-455f-b5e5-a6cdfe2d1d6c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:31.886407 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-b9bf6257-b629-455f-b5e5-a6cdfe2d1d6c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:31.887559 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b9bf6257-b629-455f-b5e5-a6cdfe2d1d6c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1725 microversion: 2.20 time: 0.152703 Oct 01 04:23:31.888117 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 336/642] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:23:31 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:23:32.067589 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-52f67245-a90f-44c8-948e-73c06c870ec8 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:32.068121 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-52f67245-a90f-44c8-948e-73c06c870ec8 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:32.075319 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52f67245-a90f-44c8-948e-73c06c870ec8 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:32.075809 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52f67245-a90f-44c8-948e-73c06c870ec8 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:32.076249 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52f67245-a90f-44c8-948e-73c06c870ec8 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:32.076968 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52f67245-a90f-44c8-948e-73c06c870ec8 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:32.077435 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52f67245-a90f-44c8-948e-73c06c870ec8 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:32.077862 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-52f67245-a90f-44c8-948e-73c06c870ec8 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:32.214045 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-52f67245-a90f-44c8-948e-73c06c870ec8 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:32.222129 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-52f67245-a90f-44c8-948e-73c06c870ec8 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a" status: 200 len: 1522 microversion: 2.1 time: 0.158423 Oct 01 04:23:32.222689 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 307/643] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:32 2022] GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:23:32.912993 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d171ba7b-fa87-4f21-8356-3f30bf80bbf7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:32.914278 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d171ba7b-fa87-4f21-8356-3f30bf80bbf7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:32.920658 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d171ba7b-fa87-4f21-8356-3f30bf80bbf7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:32.921176 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d171ba7b-fa87-4f21-8356-3f30bf80bbf7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:32.921610 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d171ba7b-fa87-4f21-8356-3f30bf80bbf7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:32.922308 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d171ba7b-fa87-4f21-8356-3f30bf80bbf7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:32.922767 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d171ba7b-fa87-4f21-8356-3f30bf80bbf7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:32.923183 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d171ba7b-fa87-4f21-8356-3f30bf80bbf7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:33.052445 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d171ba7b-fa87-4f21-8356-3f30bf80bbf7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:33.060691 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d171ba7b-fa87-4f21-8356-3f30bf80bbf7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:33.062167 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d171ba7b-fa87-4f21-8356-3f30bf80bbf7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:33.063328 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d171ba7b-fa87-4f21-8356-3f30bf80bbf7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1725 microversion: 2.20 time: 0.154223 Oct 01 04:23:33.063900 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 337/644] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:23:32 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:23:33.243659 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-76659d6a-90e7-4958-9e9d-a0ae5f328a11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:33.244275 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-76659d6a-90e7-4958-9e9d-a0ae5f328a11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:33.250589 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76659d6a-90e7-4958-9e9d-a0ae5f328a11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:33.251067 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76659d6a-90e7-4958-9e9d-a0ae5f328a11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:33.251498 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76659d6a-90e7-4958-9e9d-a0ae5f328a11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:33.252192 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76659d6a-90e7-4958-9e9d-a0ae5f328a11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:33.252650 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76659d6a-90e7-4958-9e9d-a0ae5f328a11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:33.253101 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76659d6a-90e7-4958-9e9d-a0ae5f328a11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:33.328097 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-76659d6a-90e7-4958-9e9d-a0ae5f328a11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7014a1defd81461787318bc27d56b9aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839c91c5262a49768c3e937b5a034137', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:33.337019 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-76659d6a-90e7-4958-9e9d-a0ae5f328a11 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a" status: 200 len: 1480 microversion: 2.1 time: 0.097239 Oct 01 04:23:33.337806 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 308/645] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:33 2022] GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a => generated 1480 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:23:33.375336 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-0fd7699d-1249-4c86-87c2-90debb2f6d13 req-8c3ccc42-3545-4e72-ae57-96b848b325d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2906cc69-afd9-45dd-b846-38782722ed9a", "name": "network-vif-deleted", "tag": "b4f9d636-f677-4f56-ac04-28e98716fbda"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:23:33.385947 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0fd7699d-1249-4c86-87c2-90debb2f6d13 req-8c3ccc42-3545-4e72-ae57-96b848b325d9 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:33.386443 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0fd7699d-1249-4c86-87c2-90debb2f6d13 req-8c3ccc42-3545-4e72-ae57-96b848b325d9 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:33.386877 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0fd7699d-1249-4c86-87c2-90debb2f6d13 req-8c3ccc42-3545-4e72-ae57-96b848b325d9 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:33.400224 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-0fd7699d-1249-4c86-87c2-90debb2f6d13 req-8c3ccc42-3545-4e72-ae57-96b848b325d9 service nova] Creating event network-vif-deleted:b4f9d636-f677-4f56-ac04-28e98716fbda for instance 2906cc69-afd9-45dd-b846-38782722ed9a on hv-cinder-86004 Oct 01 04:23:33.404975 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-0fd7699d-1249-4c86-87c2-90debb2f6d13 req-8c3ccc42-3545-4e72-ae57-96b848b325d9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033384 Oct 01 04:23:33.405601 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 338/646] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:23:34.089808 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-abd79157-371d-4c66-a544-3cb7b9a4d381 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:34.090439 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-abd79157-371d-4c66-a544-3cb7b9a4d381 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:34.092370 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:34.097745 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abd79157-371d-4c66-a544-3cb7b9a4d381 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:34.098240 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abd79157-371d-4c66-a544-3cb7b9a4d381 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:34.098684 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abd79157-371d-4c66-a544-3cb7b9a4d381 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:34.099384 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abd79157-371d-4c66-a544-3cb7b9a4d381 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:34.099849 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abd79157-371d-4c66-a544-3cb7b9a4d381 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:34.100283 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-abd79157-371d-4c66-a544-3cb7b9a4d381 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:34.236980 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-abd79157-371d-4c66-a544-3cb7b9a4d381 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:34.245598 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-abd79157-371d-4c66-a544-3cb7b9a4d381 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:34.247028 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-abd79157-371d-4c66-a544-3cb7b9a4d381 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:34.248172 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-abd79157-371d-4c66-a544-3cb7b9a4d381 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1725 microversion: 2.20 time: 0.163415 Oct 01 04:23:34.248723 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 309/647] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:23:34 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:23:34.360685 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6847efde-a186-4e42-9223-ae3d938eece2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:34.361420 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6847efde-a186-4e42-9223-ae3d938eece2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] [instance: 2906cc69-afd9-45dd-b846-38782722ed9a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:34.367667 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6847efde-a186-4e42-9223-ae3d938eece2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:34.368156 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6847efde-a186-4e42-9223-ae3d938eece2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:34.368597 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6847efde-a186-4e42-9223-ae3d938eece2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:34.369319 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6847efde-a186-4e42-9223-ae3d938eece2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:34.369783 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6847efde-a186-4e42-9223-ae3d938eece2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:34.370213 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6847efde-a186-4e42-9223-ae3d938eece2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:34.383443 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-6847efde-a186-4e42-9223-ae3d938eece2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] HTTP exception thrown: Instance 2906cc69-afd9-45dd-b846-38782722ed9a could not be found. Oct 01 04:23:34.385098 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6847efde-a186-4e42-9223-ae3d938eece2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Request method failure captured: Oct 01 04:23:34.385098 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a HTTP/1.1 Oct 01 04:23:34.385098 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:23:34.385098 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:23:34.385098 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:23:34.385098 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 0 Oct 01 04:23:34.385098 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:23:34.385098 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:23:34.385098 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:23:34.385098 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:23:34.385098 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN798A6ygEUFvvEkcfI7qSReKm2UxYzhCs2jYOOZOKUwCn2ocBNad4QsSD0Sc-uPRwf-i9kYKShvHWEgE5cSJRSUVxzLODzJsRfhomt7f51LXA4cAEZPLR8V-qxh0s5PTjrnOKdB2TN8W0JHxgE-z-knV9MsYBlFX3ZzUCq-ESRHWKW8 Oct 01 04:23:34.385098 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:23:34.385098 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:23:34.385098 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:23:34.385098 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:23:34.385098 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:23:34.385098 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:23:34.385098 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: 839c91c5262a49768c3e937b5a034137 Oct 01 04:23:34.385098 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-94604636 Oct 01 04:23:34.385098 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:23:34.385098 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:23:34.386562 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_839c91c5262a49768c3e937b5a034137"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/839c91c5262a49768c3e937b5a034137"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/839c91c5262a49768c3e937b5a034137"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/839c91c5262a49768c3e937b5a034137"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:23:34.386562 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-ServerRescueNegativeTestJSON-94604636 Oct 01 04:23:34.386562 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 839c91c5262a49768c3e937b5a034137 Oct 01 04:23:34.386562 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-94604636 Oct 01 04:23:34.386562 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-ServerRescueNegativeTestJSON-94604636-project Oct 01 04:23:34.386562 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:23:34.386562 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:23:34.386562 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: 7014a1defd81461787318bc27d56b9aa Oct 01 04:23:34.386562 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-ServerRescueNegativeTestJSON-94604636-project Oct 01 04:23:34.386562 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: > Oct 01 04:23:34.386562 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Instance 2906cc69-afd9-45dd-b846-38782722ed9a could not be found. Oct 01 04:23:34.386562 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'id': '2906cc69-afd9-45dd-b846-38782722ed9a'} Oct 01 04:23:34.387431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:23:34.387431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:23:34.387431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:23:34.387431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:23:34.387431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:23:34.387431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:23:34.387431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:23:34.387431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:23:34.387431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:23:34.387431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:23:34.387431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2906cc69-afd9-45dd-b846-38782722ed9a could not be found. Oct 01 04:23:34.387431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:23:34.387431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:23:34.387431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:23:34.387431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:23:34.387431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:23:34.387431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:23:34.387431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:23:34.387431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:23:34.387431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:23:34.388906 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:23:34.388906 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:23:34.388906 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:23:34.388906 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:23:34.388906 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:23:34.388906 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:23:34.388906 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:23:34.388906 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2906cc69-afd9-45dd-b846-38782722ed9a could not be found. Oct 01 04:23:34.388906 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:23:34.388906 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:23:34.388906 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:23:34.388906 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:23:34.388906 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:23:34.388906 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:23:34.388906 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:23:34.388906 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:23:34.388906 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2906cc69-afd9-45dd-b846-38782722ed9a could not be found. Oct 01 04:23:34.388906 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:23:34.390233 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6847efde-a186-4e42-9223-ae3d938eece2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] Returning 404 to user: Instance 2906cc69-afd9-45dd-b846-38782722ed9a could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:23:34.390233 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6847efde-a186-4e42-9223-ae3d938eece2 tempest-ServerRescueNegativeTestJSON-94604636 tempest-ServerRescueNegativeTestJSON-94604636-project] 10.222.0.26 "GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a" status: 404 len: 111 microversion: 2.1 time: 0.030525 Oct 01 04:23:34.390233 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 339/648] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:34 2022] GET /compute/v2.1/servers/2906cc69-afd9-45dd-b846-38782722ed9a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:23:35.274279 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-901415f8-d014-4d81-8363-d1358cea2a43 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:35.274881 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-901415f8-d014-4d81-8363-d1358cea2a43 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:35.283205 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-901415f8-d014-4d81-8363-d1358cea2a43 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:35.283695 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-901415f8-d014-4d81-8363-d1358cea2a43 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:35.284129 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-901415f8-d014-4d81-8363-d1358cea2a43 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:35.284823 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-901415f8-d014-4d81-8363-d1358cea2a43 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:35.285306 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-901415f8-d014-4d81-8363-d1358cea2a43 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:35.285735 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-901415f8-d014-4d81-8363-d1358cea2a43 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:35.536049 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-901415f8-d014-4d81-8363-d1358cea2a43 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:35.545302 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-901415f8-d014-4d81-8363-d1358cea2a43 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:35.546924 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-901415f8-d014-4d81-8363-d1358cea2a43 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:35.548501 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-901415f8-d014-4d81-8363-d1358cea2a43 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1725 microversion: 2.20 time: 0.278569 Oct 01 04:23:35.549276 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 310/649] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:23:35 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1725 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:23:36.574906 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-560d13cd-76ae-457f-a034-1277076ac94a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:36.575520 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-560d13cd-76ae-457f-a034-1277076ac94a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:36.582493 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-560d13cd-76ae-457f-a034-1277076ac94a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:36.583167 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-560d13cd-76ae-457f-a034-1277076ac94a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:36.583410 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-560d13cd-76ae-457f-a034-1277076ac94a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:36.584109 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-560d13cd-76ae-457f-a034-1277076ac94a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:36.584740 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-560d13cd-76ae-457f-a034-1277076ac94a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:36.585974 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-560d13cd-76ae-457f-a034-1277076ac94a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:36.776412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-560d13cd-76ae-457f-a034-1277076ac94a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:36.785003 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-560d13cd-76ae-457f-a034-1277076ac94a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:36.786554 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-560d13cd-76ae-457f-a034-1277076ac94a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:36.787844 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-560d13cd-76ae-457f-a034-1277076ac94a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1725 microversion: 2.20 time: 0.216942 Oct 01 04:23:36.788551 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 340/650] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:23:36 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:23:37.820754 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-78bb5b06-f965-4186-bae7-c8a2422d2828 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:37.821469 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-78bb5b06-f965-4186-bae7-c8a2422d2828 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:37.829913 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78bb5b06-f965-4186-bae7-c8a2422d2828 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:37.830493 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78bb5b06-f965-4186-bae7-c8a2422d2828 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:37.830986 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78bb5b06-f965-4186-bae7-c8a2422d2828 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:37.831922 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78bb5b06-f965-4186-bae7-c8a2422d2828 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:37.832447 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78bb5b06-f965-4186-bae7-c8a2422d2828 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:37.832987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-78bb5b06-f965-4186-bae7-c8a2422d2828 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:37.982554 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-78bb5b06-f965-4186-bae7-c8a2422d2828 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:37.990673 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-78bb5b06-f965-4186-bae7-c8a2422d2828 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:37.992823 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-78bb5b06-f965-4186-bae7-c8a2422d2828 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:37.994050 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-78bb5b06-f965-4186-bae7-c8a2422d2828 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1725 microversion: 2.20 time: 0.179081 Oct 01 04:23:37.994621 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 311/651] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:23:37 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:23:39.018851 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e52991f9-b9c6-47e0-8ada-94f92d8465c5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:39.019457 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e52991f9-b9c6-47e0-8ada-94f92d8465c5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:39.026809 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e52991f9-b9c6-47e0-8ada-94f92d8465c5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:39.027293 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e52991f9-b9c6-47e0-8ada-94f92d8465c5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:39.027726 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e52991f9-b9c6-47e0-8ada-94f92d8465c5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:39.028414 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e52991f9-b9c6-47e0-8ada-94f92d8465c5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:39.028905 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e52991f9-b9c6-47e0-8ada-94f92d8465c5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:39.029351 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e52991f9-b9c6-47e0-8ada-94f92d8465c5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:39.177863 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e52991f9-b9c6-47e0-8ada-94f92d8465c5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:39.191460 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e52991f9-b9c6-47e0-8ada-94f92d8465c5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:39.192920 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e52991f9-b9c6-47e0-8ada-94f92d8465c5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:39.194105 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e52991f9-b9c6-47e0-8ada-94f92d8465c5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1725 microversion: 2.20 time: 0.179224 Oct 01 04:23:39.194658 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 341/652] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:23:39 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:23:40.222164 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-38ece322-c15c-4a81-9570-1116908ea5fa tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:40.222773 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-38ece322-c15c-4a81-9570-1116908ea5fa tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:40.229354 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38ece322-c15c-4a81-9570-1116908ea5fa tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:40.229836 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38ece322-c15c-4a81-9570-1116908ea5fa tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:40.230271 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38ece322-c15c-4a81-9570-1116908ea5fa tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:40.230961 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38ece322-c15c-4a81-9570-1116908ea5fa tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:40.232034 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38ece322-c15c-4a81-9570-1116908ea5fa tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:40.232034 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-38ece322-c15c-4a81-9570-1116908ea5fa tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:40.234520 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:40.303380 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-46de37ff-077c-47ac-9808-d15bc172178e tempest-VolumesTestJSON-1293583048 tempest-VolumesTestJSON-1293583048-project] Calling method '.version_select at 0x7fdfbe6b1ee0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:40.353003 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-46de37ff-077c-47ac-9808-d15bc172178e tempest-VolumesTestJSON-1293583048 tempest-VolumesTestJSON-1293583048-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/ac3b8a5f-2550-495e-92e9-7c5e3237a3a1" status: 200 len: 351 microversion: 2.1 time: 0.053223 Oct 01 04:23:40.353583 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 342/653] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 1 04:23:40 2022] GET /compute/v2.1/os-volumes/ac3b8a5f-2550-495e-92e9-7c5e3237a3a1 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:23:40.363224 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-38ece322-c15c-4a81-9570-1116908ea5fa tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:40.372359 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-38ece322-c15c-4a81-9570-1116908ea5fa tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:40.373955 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-38ece322-c15c-4a81-9570-1116908ea5fa tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:40.375204 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-38ece322-c15c-4a81-9570-1116908ea5fa tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1725 microversion: 2.20 time: 0.156903 Oct 01 04:23:40.375848 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 312/654] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:23:40 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:23:40.926421 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f9ea1cf2-cbcf-47b4-a28f-b4949ef024f9 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:40.926925 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f9ea1cf2-cbcf-47b4-a28f-b4949ef024f9 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:40.933757 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9ea1cf2-cbcf-47b4-a28f-b4949ef024f9 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:40.934247 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9ea1cf2-cbcf-47b4-a28f-b4949ef024f9 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:40.934693 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9ea1cf2-cbcf-47b4-a28f-b4949ef024f9 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:40.935387 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9ea1cf2-cbcf-47b4-a28f-b4949ef024f9 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:40.935847 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9ea1cf2-cbcf-47b4-a28f-b4949ef024f9 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:40.936272 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f9ea1cf2-cbcf-47b4-a28f-b4949ef024f9 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:40.962542 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f9ea1cf2-cbcf-47b4-a28f-b4949ef024f9 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b/ips" status: 200 len: 145 microversion: 2.1 time: 0.039752 Oct 01 04:23:40.963089 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 343/655] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 1 04:23:40 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:23:41.401950 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-85a9e9e0-def4-478b-8928-b10e4538ddef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:41.402559 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-85a9e9e0-def4-478b-8928-b10e4538ddef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:41.408914 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85a9e9e0-def4-478b-8928-b10e4538ddef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:41.409426 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85a9e9e0-def4-478b-8928-b10e4538ddef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:41.409858 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85a9e9e0-def4-478b-8928-b10e4538ddef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:41.410548 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85a9e9e0-def4-478b-8928-b10e4538ddef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:41.411009 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85a9e9e0-def4-478b-8928-b10e4538ddef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:41.411431 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-85a9e9e0-def4-478b-8928-b10e4538ddef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:41.542303 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-85a9e9e0-def4-478b-8928-b10e4538ddef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:41.550662 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-85a9e9e0-def4-478b-8928-b10e4538ddef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:41.552097 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-85a9e9e0-def4-478b-8928-b10e4538ddef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:41.553282 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-85a9e9e0-def4-478b-8928-b10e4538ddef tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1725 microversion: 2.20 time: 0.155520 Oct 01 04:23:41.553840 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 313/656] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:23:41 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:23:41.689592 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2bc236f2-6759-4eaf-8972-29fd9e0f4a3e tempest-VolumesTestJSON-1293583048 tempest-VolumesTestJSON-1293583048-project] Calling method '.version_select at 0x7fdfbe7f73a0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:41.736582 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2bc236f2-6759-4eaf-8972-29fd9e0f4a3e tempest-VolumesTestJSON-1293583048 tempest-VolumesTestJSON-1293583048-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/74357ec8-9295-4d49-a1d9-27a5f952ae03" status: 200 len: 350 microversion: 2.1 time: 0.050669 Oct 01 04:23:41.737175 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 344/657] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 1 04:23:41 2022] GET /compute/v2.1/os-volumes/74357ec8-9295-4d49-a1d9-27a5f952ae03 => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:23:42.294641 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f56aaad2-9ca6-4598-a9ce-1d18896771e4 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6b4d7f0-3402-40ba-ad9a-0f3c791f6596"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:23:42.297119 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f56aaad2-9ca6-4598-a9ce-1d18896771e4 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:42.303050 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f56aaad2-9ca6-4598-a9ce-1d18896771e4 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:42.303540 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f56aaad2-9ca6-4598-a9ce-1d18896771e4 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:42.303982 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f56aaad2-9ca6-4598-a9ce-1d18896771e4 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:42.304710 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f56aaad2-9ca6-4598-a9ce-1d18896771e4 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:42.305270 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f56aaad2-9ca6-4598-a9ce-1d18896771e4 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:42.305705 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f56aaad2-9ca6-4598-a9ce-1d18896771e4 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:42.578316 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5ace8451-5cb3-444c-ac3d-c8b4701cbca2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:42.579238 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5ace8451-5cb3-444c-ac3d-c8b4701cbca2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:42.586360 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ace8451-5cb3-444c-ac3d-c8b4701cbca2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:42.587223 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ace8451-5cb3-444c-ac3d-c8b4701cbca2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:42.587577 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ace8451-5cb3-444c-ac3d-c8b4701cbca2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:42.588474 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ace8451-5cb3-444c-ac3d-c8b4701cbca2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:42.588995 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ace8451-5cb3-444c-ac3d-c8b4701cbca2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:42.589425 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5ace8451-5cb3-444c-ac3d-c8b4701cbca2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:42.615942 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f56aaad2-9ca6-4598-a9ce-1d18896771e4 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "POST /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.325126 Oct 01 04:23:42.616569 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 314/658] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 1 04:23:42 2022] POST /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:23:42.731503 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-5ace8451-5cb3-444c-ac3d-c8b4701cbca2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:42.744061 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-5ace8451-5cb3-444c-ac3d-c8b4701cbca2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:42.745812 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-5ace8451-5cb3-444c-ac3d-c8b4701cbca2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:42.746998 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5ace8451-5cb3-444c-ac3d-c8b4701cbca2 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1746 microversion: 2.20 time: 0.172808 Oct 01 04:23:42.747733 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 345/659] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:23:42 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1746 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:23:43.085939 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2c11ce90-9d68-4bca-b4fe-471f5bee4171 tempest-VolumesTestJSON-1293583048 tempest-VolumesTestJSON-1293583048-project] Calling method '.version_select at 0x7fdfbe729430>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:43.132163 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2c11ce90-9d68-4bca-b4fe-471f5bee4171 tempest-VolumesTestJSON-1293583048 tempest-VolumesTestJSON-1293583048-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/11b4e548-5058-482d-9767-b855d751e748" status: 200 len: 350 microversion: 2.1 time: 0.050894 Oct 01 04:23:43.132784 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 315/660] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 1 04:23:43 2022] GET /compute/v2.1/os-volumes/11b4e548-5058-482d-9767-b855d751e748 => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:23:43.145804 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c50aede3-d778-4c85-a62e-c8d52edc94dd tempest-VolumesTestJSON-1293583048 tempest-VolumesTestJSON-1293583048-project] Calling method '.version_select at 0x7fdfbe8465e0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:43.233942 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c50aede3-d778-4c85-a62e-c8d52edc94dd tempest-VolumesTestJSON-1293583048 tempest-VolumesTestJSON-1293583048-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.092199 Oct 01 04:23:43.234510 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 346/661] 10.222.0.26 () {58 vars in 1134 bytes} [Sat Oct 1 04:23:43 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:23:43.249263 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d5ab1d67-dda8-4452-b845-5cb26f206cf1 tempest-VolumesTestJSON-1293583048 tempest-VolumesTestJSON-1293583048-project] Calling method '.version_select at 0x7fdfbe6cbf70>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:43.331949 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d5ab1d67-dda8-4452-b845-5cb26f206cf1 tempest-VolumesTestJSON-1293583048 tempest-VolumesTestJSON-1293583048-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.086862 Oct 01 04:23:43.332590 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 316/662] 10.222.0.26 () {58 vars in 1149 bytes} [Sat Oct 1 04:23:43 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:23:43.346694 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8ba04eb6-1893-41ba-bea8-451ae0a70c21 tempest-VolumesTestJSON-1293583048 tempest-VolumesTestJSON-1293583048-project] Calling method '.version_select at 0x7fdfbe73fca0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:43.429038 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8ba04eb6-1893-41ba-bea8-451ae0a70c21 tempest-VolumesTestJSON-1293583048 tempest-VolumesTestJSON-1293583048-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.086043 Oct 01 04:23:43.429614 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 347/663] 10.222.0.26 () {58 vars in 1134 bytes} [Sat Oct 1 04:23:43 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:23:43.443241 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9e446b8d-c72f-49de-ab1a-0d73f29e3a0b tempest-VolumesTestJSON-1293583048 tempest-VolumesTestJSON-1293583048-project] Calling method '.version_select at 0x7fdfbe6cb040>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:43.532603 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9e446b8d-c72f-49de-ab1a-0d73f29e3a0b tempest-VolumesTestJSON-1293583048 tempest-VolumesTestJSON-1293583048-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.092718 Oct 01 04:23:43.532955 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 317/664] 10.222.0.26 () {58 vars in 1167 bytes} [Sat Oct 1 04:23:43 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:23:43.547074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e912c475-6403-43c7-aea0-04679cb7e4bc tempest-VolumesTestJSON-1293583048 tempest-VolumesTestJSON-1293583048-project] Calling method '.version_select at 0x7fdfbe652040>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:43.630190 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e912c475-6403-43c7-aea0-04679cb7e4bc tempest-VolumesTestJSON-1293583048 tempest-VolumesTestJSON-1293583048-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.086786 Oct 01 04:23:43.630896 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 348/665] 10.222.0.26 () {58 vars in 1170 bytes} [Sat Oct 1 04:23:43 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:23:43.645027 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-67fad684-907a-4155-ae3f-778c28bc597f tempest-VolumesTestJSON-1293583048 tempest-VolumesTestJSON-1293583048-project] Calling method '.version_select at 0x7fdfbe751160>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:43.776097 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d53043e2-dc9c-4d21-a548-3052dd18caf6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:43.777428 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d53043e2-dc9c-4d21-a548-3052dd18caf6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:43.784576 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d53043e2-dc9c-4d21-a548-3052dd18caf6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:43.785441 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d53043e2-dc9c-4d21-a548-3052dd18caf6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:43.786128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d53043e2-dc9c-4d21-a548-3052dd18caf6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:43.787122 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d53043e2-dc9c-4d21-a548-3052dd18caf6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:43.787557 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d53043e2-dc9c-4d21-a548-3052dd18caf6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:43.787979 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d53043e2-dc9c-4d21-a548-3052dd18caf6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:43.891975 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-67fad684-907a-4155-ae3f-778c28bc597f tempest-VolumesTestJSON-1293583048 tempest-VolumesTestJSON-1293583048-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.250704 Oct 01 04:23:43.892557 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 318/666] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 1 04:23:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:23:43.907451 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-82c2e58b-17af-437a-a215-6c71a9d35cd7 tempest-VolumesTestJSON-1293583048 tempest-VolumesTestJSON-1293583048-project] Calling method '.version_select at 0x7fdfbe913e50>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:43.929245 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d53043e2-dc9c-4d21-a548-3052dd18caf6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:43.938004 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d53043e2-dc9c-4d21-a548-3052dd18caf6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:43.939453 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d53043e2-dc9c-4d21-a548-3052dd18caf6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:43.940611 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d53043e2-dc9c-4d21-a548-3052dd18caf6 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1746 microversion: 2.20 time: 0.170443 Oct 01 04:23:43.941200 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 349/667] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:23:43 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1746 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:23:43.989302 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-82c2e58b-17af-437a-a215-6c71a9d35cd7 tempest-VolumesTestJSON-1293583048 tempest-VolumesTestJSON-1293583048-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.085451 Oct 01 04:23:43.989875 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 319/668] 10.222.0.26 () {58 vars in 1188 bytes} [Sat Oct 1 04:23:43 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:23:44.003614 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-63353f25-1b54-42dc-840e-de1a32633ad5 tempest-VolumesTestJSON-1293583048 tempest-VolumesTestJSON-1293583048-project] Calling method '.version_select at 0x7fdfbe729d30>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:44.084906 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-63353f25-1b54-42dc-840e-de1a32633ad5 tempest-VolumesTestJSON-1293583048 tempest-VolumesTestJSON-1293583048-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084978 Oct 01 04:23:44.085503 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 350/669] 10.222.0.26 () {58 vars in 1155 bytes} [Sat Oct 1 04:23:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:23:44.968302 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-94a58771-dd55-4ac0-9151-8364b3a1933a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:44.969171 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-94a58771-dd55-4ac0-9151-8364b3a1933a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:44.975881 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94a58771-dd55-4ac0-9151-8364b3a1933a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:44.977078 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94a58771-dd55-4ac0-9151-8364b3a1933a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:44.977600 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94a58771-dd55-4ac0-9151-8364b3a1933a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:44.978459 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94a58771-dd55-4ac0-9151-8364b3a1933a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:44.978992 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94a58771-dd55-4ac0-9151-8364b3a1933a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:44.979481 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94a58771-dd55-4ac0-9151-8364b3a1933a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:45.126821 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-94a58771-dd55-4ac0-9151-8364b3a1933a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:45.135820 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-94a58771-dd55-4ac0-9151-8364b3a1933a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:45.137579 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-94a58771-dd55-4ac0-9151-8364b3a1933a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:45.138915 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-94a58771-dd55-4ac0-9151-8364b3a1933a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1741 microversion: 2.20 time: 0.174948 Oct 01 04:23:45.139463 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 320/670] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:23:44 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:23:45.825421 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-6c4a6efa-634b-43a4-b538-aee56ce3bd48 req-98486800-615f-4c0d-befe-d8762224c033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b21e7357-43a2-4dc9-b0f6-26b14b68c464", "name": "network-vif-plugged", "status": "completed", "tag": "735577aa-5ec2-48d4-8f41-38cb8f95250a"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:23:45.847933 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6c4a6efa-634b-43a4-b538-aee56ce3bd48 req-98486800-615f-4c0d-befe-d8762224c033 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:45.848585 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6c4a6efa-634b-43a4-b538-aee56ce3bd48 req-98486800-615f-4c0d-befe-d8762224c033 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:45.849063 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-6c4a6efa-634b-43a4-b538-aee56ce3bd48 req-98486800-615f-4c0d-befe-d8762224c033 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:45.862499 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-6c4a6efa-634b-43a4-b538-aee56ce3bd48 req-98486800-615f-4c0d-befe-d8762224c033 service nova] Creating event network-vif-plugged:735577aa-5ec2-48d4-8f41-38cb8f95250a for instance b21e7357-43a2-4dc9-b0f6-26b14b68c464 on hv-cinder-86004 Oct 01 04:23:45.867778 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-6c4a6efa-634b-43a4-b538-aee56ce3bd48 req-98486800-615f-4c0d-befe-d8762224c033 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213760 Oct 01 04:23:45.871736 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 351/671] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:23:46.168532 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-aabd24f5-9228-4078-a3cc-6f650309ac8b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:46.169108 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-aabd24f5-9228-4078-a3cc-6f650309ac8b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:46.177386 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aabd24f5-9228-4078-a3cc-6f650309ac8b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:46.178229 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aabd24f5-9228-4078-a3cc-6f650309ac8b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:46.178855 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aabd24f5-9228-4078-a3cc-6f650309ac8b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:46.180343 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aabd24f5-9228-4078-a3cc-6f650309ac8b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:46.181393 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aabd24f5-9228-4078-a3cc-6f650309ac8b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:46.182254 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aabd24f5-9228-4078-a3cc-6f650309ac8b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:46.350685 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-aabd24f5-9228-4078-a3cc-6f650309ac8b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:46.360699 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-aabd24f5-9228-4078-a3cc-6f650309ac8b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:46.362468 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-aabd24f5-9228-4078-a3cc-6f650309ac8b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:46.363854 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-aabd24f5-9228-4078-a3cc-6f650309ac8b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1741 microversion: 2.20 time: 0.199438 Oct 01 04:23:46.364725 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 321/672] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:23:46 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1741 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:23:47.391525 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-97c0909d-b29b-4c38-abfb-278c14b310f5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:47.392222 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-97c0909d-b29b-4c38-abfb-278c14b310f5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:47.399053 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97c0909d-b29b-4c38-abfb-278c14b310f5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:47.399751 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97c0909d-b29b-4c38-abfb-278c14b310f5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:47.400196 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97c0909d-b29b-4c38-abfb-278c14b310f5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:47.400898 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97c0909d-b29b-4c38-abfb-278c14b310f5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:47.401406 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97c0909d-b29b-4c38-abfb-278c14b310f5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:47.401835 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-97c0909d-b29b-4c38-abfb-278c14b310f5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:47.557340 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-97c0909d-b29b-4c38-abfb-278c14b310f5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:47.573721 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-97c0909d-b29b-4c38-abfb-278c14b310f5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:47.575499 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-97c0909d-b29b-4c38-abfb-278c14b310f5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:47.576767 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-97c0909d-b29b-4c38-abfb-278c14b310f5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1741 microversion: 2.20 time: 0.190017 Oct 01 04:23:47.593486 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 352/673] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:23:47 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1741 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:23:48.604107 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-68a2f50a-fbe9-48c5-8579-60dce55576ce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:48.604718 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-68a2f50a-fbe9-48c5-8579-60dce55576ce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:48.613296 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68a2f50a-fbe9-48c5-8579-60dce55576ce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:48.615569 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68a2f50a-fbe9-48c5-8579-60dce55576ce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:48.617640 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68a2f50a-fbe9-48c5-8579-60dce55576ce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:48.620293 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68a2f50a-fbe9-48c5-8579-60dce55576ce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:48.620771 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68a2f50a-fbe9-48c5-8579-60dce55576ce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:48.621252 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68a2f50a-fbe9-48c5-8579-60dce55576ce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:48.784172 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-68a2f50a-fbe9-48c5-8579-60dce55576ce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:48.794813 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-68a2f50a-fbe9-48c5-8579-60dce55576ce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:48.796709 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-68a2f50a-fbe9-48c5-8579-60dce55576ce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:48.798318 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-68a2f50a-fbe9-48c5-8579-60dce55576ce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1741 microversion: 2.20 time: 0.198617 Oct 01 04:23:48.798864 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 322/674] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:23:48 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1741 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:23:48.871853 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2e30a98e-a1c3-4d27-9507-e662c297c9b5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:48.872416 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2e30a98e-a1c3-4d27-9507-e662c297c9b5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:48.899351 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e30a98e-a1c3-4d27-9507-e662c297c9b5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:48.902146 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e30a98e-a1c3-4d27-9507-e662c297c9b5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:48.902957 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e30a98e-a1c3-4d27-9507-e662c297c9b5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:48.905963 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e30a98e-a1c3-4d27-9507-e662c297c9b5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:48.909021 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e30a98e-a1c3-4d27-9507-e662c297c9b5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:48.910863 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e30a98e-a1c3-4d27-9507-e662c297c9b5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:48.971081 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2e30a98e-a1c3-4d27-9507-e662c297c9b5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 04:23:49.120608 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2e30a98e-a1c3-4d27-9507-e662c297c9b5 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 204 len: 0 microversion: 2.1 time: 0.252715 Oct 01 04:23:49.130598 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 353/675] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 1 04:23:48 2022] DELETE /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 04:23:49.130842 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a81c34f7-ae86-4733-8131-0ade9c339f71 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:49.131611 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a81c34f7-ae86-4733-8131-0ade9c339f71 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:49.147708 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a81c34f7-ae86-4733-8131-0ade9c339f71 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:49.150266 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a81c34f7-ae86-4733-8131-0ade9c339f71 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:49.150720 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a81c34f7-ae86-4733-8131-0ade9c339f71 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:49.151483 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a81c34f7-ae86-4733-8131-0ade9c339f71 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:49.151954 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a81c34f7-ae86-4733-8131-0ade9c339f71 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:49.152795 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a81c34f7-ae86-4733-8131-0ade9c339f71 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:49.334665 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-a81c34f7-ae86-4733-8131-0ade9c339f71 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:49.352479 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a81c34f7-ae86-4733-8131-0ade9c339f71 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1577 microversion: 2.1 time: 0.225734 Oct 01 04:23:49.353102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 323/676] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:49 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1577 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:23:49.837112 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-53566de1-5204-4e71-9ba8-0ad993367f2d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:49.838009 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-53566de1-5204-4e71-9ba8-0ad993367f2d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:49.844792 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53566de1-5204-4e71-9ba8-0ad993367f2d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:49.845312 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53566de1-5204-4e71-9ba8-0ad993367f2d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:49.845748 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53566de1-5204-4e71-9ba8-0ad993367f2d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:49.846453 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53566de1-5204-4e71-9ba8-0ad993367f2d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:49.846905 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53566de1-5204-4e71-9ba8-0ad993367f2d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:49.847329 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-53566de1-5204-4e71-9ba8-0ad993367f2d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:50.002993 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-53566de1-5204-4e71-9ba8-0ad993367f2d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:50.014735 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-53566de1-5204-4e71-9ba8-0ad993367f2d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:50.016241 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-53566de1-5204-4e71-9ba8-0ad993367f2d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:50.017508 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-53566de1-5204-4e71-9ba8-0ad993367f2d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1741 microversion: 2.20 time: 0.186570 Oct 01 04:23:50.018821 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 354/677] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:23:49 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1741 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:23:50.384617 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b0af84d0-e6e7-45ef-96c7-1ee9b2afc482 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:50.385101 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b15831fe-37f5-439e-b49f-94532938c7f1 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:50.385765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b15831fe-37f5-439e-b49f-94532938c7f1 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:50.388906 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b0af84d0-e6e7-45ef-96c7-1ee9b2afc482 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:50.392114 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b15831fe-37f5-439e-b49f-94532938c7f1 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:50.392610 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b15831fe-37f5-439e-b49f-94532938c7f1 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:50.393077 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b15831fe-37f5-439e-b49f-94532938c7f1 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:50.393974 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b15831fe-37f5-439e-b49f-94532938c7f1 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:50.394617 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b15831fe-37f5-439e-b49f-94532938c7f1 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:50.395206 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0af84d0-e6e7-45ef-96c7-1ee9b2afc482 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:50.395347 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b15831fe-37f5-439e-b49f-94532938c7f1 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:50.395829 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0af84d0-e6e7-45ef-96c7-1ee9b2afc482 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:50.396611 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0af84d0-e6e7-45ef-96c7-1ee9b2afc482 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:50.397660 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0af84d0-e6e7-45ef-96c7-1ee9b2afc482 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:50.398315 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0af84d0-e6e7-45ef-96c7-1ee9b2afc482 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:50.398755 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b0af84d0-e6e7-45ef-96c7-1ee9b2afc482 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:50.435257 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b0af84d0-e6e7-45ef-96c7-1ee9b2afc482 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055224 Oct 01 04:23:50.441779 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 355/678] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 1 04:23:50 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:23:50.449149 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-249abb68-6bb8-47cb-b3cc-d34259de2805 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:50.450330 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-249abb68-6bb8-47cb-b3cc-d34259de2805 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:50.456491 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-249abb68-6bb8-47cb-b3cc-d34259de2805 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:50.457088 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-249abb68-6bb8-47cb-b3cc-d34259de2805 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:50.457594 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-249abb68-6bb8-47cb-b3cc-d34259de2805 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:50.459016 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-249abb68-6bb8-47cb-b3cc-d34259de2805 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:50.459551 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-249abb68-6bb8-47cb-b3cc-d34259de2805 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:50.460030 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-249abb68-6bb8-47cb-b3cc-d34259de2805 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:50.532426 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-249abb68-6bb8-47cb-b3cc-d34259de2805 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b/os-volume_attachments/b6b4d7f0-3402-40ba-ad9a-0f3c791f6596" status: 200 len: 194 microversion: 2.1 time: 0.088198 Oct 01 04:23:50.533051 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 356/679] 10.222.0.26 () {58 vars in 1413 bytes} [Sat Oct 1 04:23:50 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b/os-volume_attachments/b6b4d7f0-3402-40ba-ad9a-0f3c791f6596 => generated 194 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:23:50.609866 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-b15831fe-37f5-439e-b49f-94532938c7f1 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:50.620845 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b15831fe-37f5-439e-b49f-94532938c7f1 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1577 microversion: 2.1 time: 0.240901 Oct 01 04:23:50.622626 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 324/680] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:50 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1577 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:23:51.048658 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-41ba14c3-939f-4267-9877-0edaf00f2738 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:51.049366 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-41ba14c3-939f-4267-9877-0edaf00f2738 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:51.057211 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41ba14c3-939f-4267-9877-0edaf00f2738 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:51.058099 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41ba14c3-939f-4267-9877-0edaf00f2738 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:51.058734 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41ba14c3-939f-4267-9877-0edaf00f2738 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:51.059694 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41ba14c3-939f-4267-9877-0edaf00f2738 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:51.060359 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41ba14c3-939f-4267-9877-0edaf00f2738 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:51.061003 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-41ba14c3-939f-4267-9877-0edaf00f2738 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:51.294690 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-41ba14c3-939f-4267-9877-0edaf00f2738 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:51.307396 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-41ba14c3-939f-4267-9877-0edaf00f2738 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:51.309469 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-41ba14c3-939f-4267-9877-0edaf00f2738 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:51.311611 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-41ba14c3-939f-4267-9877-0edaf00f2738 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1741 microversion: 2.20 time: 0.270224 Oct 01 04:23:51.345346 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 357/681] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:23:51 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1741 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:23:51.650803 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-68a14b0a-1944-4330-8da3-69c7a10a6b21 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:51.653166 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-68a14b0a-1944-4330-8da3-69c7a10a6b21 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:51.660818 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68a14b0a-1944-4330-8da3-69c7a10a6b21 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:51.661557 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68a14b0a-1944-4330-8da3-69c7a10a6b21 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:51.662218 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68a14b0a-1944-4330-8da3-69c7a10a6b21 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:51.663296 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68a14b0a-1944-4330-8da3-69c7a10a6b21 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:51.664615 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68a14b0a-1944-4330-8da3-69c7a10a6b21 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:51.665504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-68a14b0a-1944-4330-8da3-69c7a10a6b21 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:51.745219 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-68a14b0a-1944-4330-8da3-69c7a10a6b21 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:51.754768 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-68a14b0a-1944-4330-8da3-69c7a10a6b21 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1509 microversion: 2.1 time: 0.112495 Oct 01 04:23:51.755706 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 325/682] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:51 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1509 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:23:52.020625 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-d01944d4-0ef4-4bb2-b4b3-d299c171fe2a req-beb80c53-3ccc-42a1-a7b6-911e28b2ed47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b31127e-af32-4116-90df-f27354ee55f4", "name": "network-vif-deleted", "tag": "12264ff5-12ea-4894-9a40-7cdf57c7ecb0"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:23:52.050195 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d01944d4-0ef4-4bb2-b4b3-d299c171fe2a req-beb80c53-3ccc-42a1-a7b6-911e28b2ed47 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:52.050879 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d01944d4-0ef4-4bb2-b4b3-d299c171fe2a req-beb80c53-3ccc-42a1-a7b6-911e28b2ed47 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:52.051115 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-d01944d4-0ef4-4bb2-b4b3-d299c171fe2a req-beb80c53-3ccc-42a1-a7b6-911e28b2ed47 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:52.084243 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-d01944d4-0ef4-4bb2-b4b3-d299c171fe2a req-beb80c53-3ccc-42a1-a7b6-911e28b2ed47 service nova] Creating event network-vif-deleted:12264ff5-12ea-4894-9a40-7cdf57c7ecb0 for instance 1b31127e-af32-4116-90df-f27354ee55f4 on hv-cinder-86004 Oct 01 04:23:52.109296 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-873f7dbb-82c4-41d4-a3cf-4f47db0a53ae tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6e7d7d6-6182-4abf-bbe6-db27c32cadf3"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:23:52.120656 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-d01944d4-0ef4-4bb2-b4b3-d299c171fe2a req-beb80c53-3ccc-42a1-a7b6-911e28b2ed47 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104424 Oct 01 04:23:52.130210 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-873f7dbb-82c4-41d4-a3cf-4f47db0a53ae tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:52.137030 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 358/683] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:23:52.155594 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-873f7dbb-82c4-41d4-a3cf-4f47db0a53ae tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:52.156116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-873f7dbb-82c4-41d4-a3cf-4f47db0a53ae tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:52.156569 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-873f7dbb-82c4-41d4-a3cf-4f47db0a53ae tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:52.157413 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-873f7dbb-82c4-41d4-a3cf-4f47db0a53ae tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:52.158073 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-873f7dbb-82c4-41d4-a3cf-4f47db0a53ae tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:52.159187 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-873f7dbb-82c4-41d4-a3cf-4f47db0a53ae tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:52.343992 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2d55f794-ed54-476a-aa36-b72149017bd8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:52.344711 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2d55f794-ed54-476a-aa36-b72149017bd8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:52.355820 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d55f794-ed54-476a-aa36-b72149017bd8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:52.356414 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d55f794-ed54-476a-aa36-b72149017bd8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:52.357087 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d55f794-ed54-476a-aa36-b72149017bd8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:52.358088 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d55f794-ed54-476a-aa36-b72149017bd8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:52.358766 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d55f794-ed54-476a-aa36-b72149017bd8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:52.359550 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2d55f794-ed54-476a-aa36-b72149017bd8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:52.616117 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2d55f794-ed54-476a-aa36-b72149017bd8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:52.622896 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:52.637810 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2d55f794-ed54-476a-aa36-b72149017bd8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:52.640089 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2d55f794-ed54-476a-aa36-b72149017bd8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:52.649476 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2d55f794-ed54-476a-aa36-b72149017bd8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1741 microversion: 2.20 time: 0.310470 Oct 01 04:23:52.650640 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 359/684] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:23:52 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1741 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:23:52.685538 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-873f7dbb-82c4-41d4-a3cf-4f47db0a53ae tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "POST /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.583068 Oct 01 04:23:52.687540 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 326/685] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 1 04:23:52 2022] POST /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b/os-volume_attachments => generated 194 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:23:52.781284 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-889109a7-4bee-40fd-ad6a-637fe8686ef9 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:52.782047 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-889109a7-4bee-40fd-ad6a-637fe8686ef9 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:52.790997 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-889109a7-4bee-40fd-ad6a-637fe8686ef9 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:52.791614 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-889109a7-4bee-40fd-ad6a-637fe8686ef9 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:52.792115 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-889109a7-4bee-40fd-ad6a-637fe8686ef9 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:52.792904 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-889109a7-4bee-40fd-ad6a-637fe8686ef9 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:52.793463 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-889109a7-4bee-40fd-ad6a-637fe8686ef9 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:52.793965 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-889109a7-4bee-40fd-ad6a-637fe8686ef9 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:52.839677 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-889109a7-4bee-40fd-ad6a-637fe8686ef9 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:52.841001 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-889109a7-4bee-40fd-ad6a-637fe8686ef9 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:52.841694 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-889109a7-4bee-40fd-ad6a-637fe8686ef9 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:52.842376 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-889109a7-4bee-40fd-ad6a-637fe8686ef9 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lazy-loading 'fault' on Instance uuid 1b31127e-af32-4116-90df-f27354ee55f4 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:23:52.901733 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-889109a7-4bee-40fd-ad6a-637fe8686ef9 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:52.915662 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-889109a7-4bee-40fd-ad6a-637fe8686ef9 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 200 len: 1230 microversion: 2.1 time: 0.138805 Oct 01 04:23:52.927182 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 360/686] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:52 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 1230 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:23:53.679805 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-602811be-3f9d-45b1-b666-474c58064baf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:53.681740 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-602811be-3f9d-45b1-b666-474c58064baf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:53.701614 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-602811be-3f9d-45b1-b666-474c58064baf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:53.702815 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-602811be-3f9d-45b1-b666-474c58064baf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:53.703417 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-602811be-3f9d-45b1-b666-474c58064baf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:53.704439 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-602811be-3f9d-45b1-b666-474c58064baf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:53.705122 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-602811be-3f9d-45b1-b666-474c58064baf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:53.708893 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-602811be-3f9d-45b1-b666-474c58064baf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:53.925434 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-602811be-3f9d-45b1-b666-474c58064baf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:53.942820 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4668eb4f-0d55-4797-a69e-2a5d7e1dca12 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:53.944555 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-4668eb4f-0d55-4797-a69e-2a5d7e1dca12 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:53.953450 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-602811be-3f9d-45b1-b666-474c58064baf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:53.958434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4668eb4f-0d55-4797-a69e-2a5d7e1dca12 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:53.958710 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-602811be-3f9d-45b1-b666-474c58064baf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:53.960116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-602811be-3f9d-45b1-b666-474c58064baf tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1741 microversion: 2.20 time: 0.288031 Oct 01 04:23:53.961021 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4668eb4f-0d55-4797-a69e-2a5d7e1dca12 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:53.961793 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4668eb4f-0d55-4797-a69e-2a5d7e1dca12 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:53.962544 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 327/687] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:23:53 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1741 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:23:53.963431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4668eb4f-0d55-4797-a69e-2a5d7e1dca12 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:53.964070 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4668eb4f-0d55-4797-a69e-2a5d7e1dca12 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:53.964656 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-4668eb4f-0d55-4797-a69e-2a5d7e1dca12 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:53.984404 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-4668eb4f-0d55-4797-a69e-2a5d7e1dca12 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] HTTP exception thrown: Instance 1b31127e-af32-4116-90df-f27354ee55f4 could not be found. Oct 01 04:23:53.991128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4668eb4f-0d55-4797-a69e-2a5d7e1dca12 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Request method failure captured: Oct 01 04:23:53.991128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 HTTP/1.1 Oct 01 04:23:53.991128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:23:53.991128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:23:53.991128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:23:53.991128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 0 Oct 01 04:23:53.991128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:23:53.991128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:23:53.991128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:23:53.991128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:23:53.991128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN7_-6vOf5LAXMJpNxgHCXAL5Yp_KV-I0ygMkF8xEYZOdOvZKckxX5HUNO3pw108A69ZwDA0bYsnx9P5YHYocO16Z7ax6mNXSFOBYjPJMQdJY1ME4QGMgu0rxDHvGGJq-CjqrTfLFyN7kotOulhYPoCsLTqZiUqAg5_l6o0qdPQrD0SE Oct 01 04:23:53.991128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:23:53.991128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:23:53.991128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:23:53.991128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:23:53.991128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:23:53.991128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:23:53.991128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: 721dd52b82194e4d91113d4d688900ae Oct 01 04:23:53.991128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-TestVolumeBootPattern-774411632 Oct 01 04:23:53.991128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:23:53.991128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:23:53.993635 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_721dd52b82194e4d91113d4d688900ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/721dd52b82194e4d91113d4d688900ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/721dd52b82194e4d91113d4d688900ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/721dd52b82194e4d91113d4d688900ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:23:53.993635 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-TestVolumeBootPattern-774411632 Oct 01 04:23:53.993635 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 721dd52b82194e4d91113d4d688900ae Oct 01 04:23:53.993635 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestVolumeBootPattern-774411632 Oct 01 04:23:53.993635 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-TestVolumeBootPattern-774411632-project Oct 01 04:23:53.993635 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:23:53.993635 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:23:53.993635 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: dea6fd8e6a374cd5b12ec7d99f285203 Oct 01 04:23:53.993635 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-TestVolumeBootPattern-774411632-project Oct 01 04:23:53.993635 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: > Oct 01 04:23:53.993635 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Instance 1b31127e-af32-4116-90df-f27354ee55f4 could not be found. Oct 01 04:23:53.993635 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'id': '1b31127e-af32-4116-90df-f27354ee55f4'} Oct 01 04:23:53.995367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:23:53.995367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:23:53.995367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:23:53.995367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:23:53.995367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:23:53.995367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:23:53.995367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:23:53.995367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:23:53.995367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:23:53.995367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:23:53.995367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b31127e-af32-4116-90df-f27354ee55f4 could not be found. Oct 01 04:23:53.995367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:23:53.995367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:23:53.995367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:23:53.995367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:23:53.995367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:23:53.995367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:23:53.995367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:23:53.995367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:23:53.995367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:23:53.996961 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:23:53.996961 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:23:53.996961 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:23:53.996961 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:23:53.996961 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:23:53.996961 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:23:53.996961 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:23:53.996961 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b31127e-af32-4116-90df-f27354ee55f4 could not be found. Oct 01 04:23:53.996961 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:23:53.996961 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:23:53.996961 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:23:53.996961 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:23:53.996961 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:23:53.996961 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:23:53.996961 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:23:53.996961 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:23:53.996961 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b31127e-af32-4116-90df-f27354ee55f4 could not be found. Oct 01 04:23:53.996961 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:23:53.998418 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-4668eb4f-0d55-4797-a69e-2a5d7e1dca12 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Returning 404 to user: Instance 1b31127e-af32-4116-90df-f27354ee55f4 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:23:53.998418 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-4668eb4f-0d55-4797-a69e-2a5d7e1dca12 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 404 len: 111 microversion: 2.1 time: 0.058085 Oct 01 04:23:53.998418 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 361/688] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:53 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 04:23:54.150085 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5af13fee-c26a-441a-b412-1df46e534478 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1107716242", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1277045486", "security_groups": [{"name": "tempest-secgroup-smoke-1256671354"}], "block_device_mapping_v2": [{"uuid": "06096119-8014-48aa-be10-d144823df947", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a58a68a2-3485-47fc-a402-341c963919cc"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:23:54.351283 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-5af13fee-c26a-441a-b412-1df46e534478 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] validate_networks() for [('a58a68a2-3485-47fc-a402-341c963919cc', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 04:23:54.893734 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-5af13fee-c26a-441a-b412-1df46e534478 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 04:23:54.895041 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-5af13fee-c26a-441a-b412-1df46e534478 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 04:23:54.895712 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-5af13fee-c26a-441a-b412-1df46e534478 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 04:23:54.896434 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-5af13fee-c26a-441a-b412-1df46e534478 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 04:23:54.896854 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-5af13fee-c26a-441a-b412-1df46e534478 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 04:23:54.907776 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5af13fee-c26a-441a-b412-1df46e534478 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:54.908290 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5af13fee-c26a-441a-b412-1df46e534478 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:54.908738 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5af13fee-c26a-441a-b412-1df46e534478 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:54.909581 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5af13fee-c26a-441a-b412-1df46e534478 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:54.910231 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5af13fee-c26a-441a-b412-1df46e534478 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:54.910968 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5af13fee-c26a-441a-b412-1df46e534478 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:54.931973 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-5af13fee-c26a-441a-b412-1df46e534478 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Getting quotas for project 721dd52b82194e4d91113d4d688900ae. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:23:54.936964 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-5af13fee-c26a-441a-b412-1df46e534478 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Getting quotas for user dea6fd8e6a374cd5b12ec7d99f285203 and project 721dd52b82194e4d91113d4d688900ae. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:23:54.992832 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bff011ef-7ba9-46d2-b7bd-e9fa446c3cff tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:54.993717 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bff011ef-7ba9-46d2-b7bd-e9fa446c3cff tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:54.996311 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:55.008476 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5af13fee-c26a-441a-b412-1df46e534478 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 04:23:55.009754 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bff011ef-7ba9-46d2-b7bd-e9fa446c3cff tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:55.010333 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bff011ef-7ba9-46d2-b7bd-e9fa446c3cff tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:55.010922 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5af13fee-c26a-441a-b412-1df46e534478 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 87cd0cbd-547d-4e0e-a797-7971ce307b17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='06096119-8014-48aa-be10-d144823df947',volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 04:23:55.011450 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bff011ef-7ba9-46d2-b7bd-e9fa446c3cff tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:55.016195 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bff011ef-7ba9-46d2-b7bd-e9fa446c3cff tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:55.016680 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bff011ef-7ba9-46d2-b7bd-e9fa446c3cff tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:55.017145 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bff011ef-7ba9-46d2-b7bd-e9fa446c3cff tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:55.190982 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-bff011ef-7ba9-46d2-b7bd-e9fa446c3cff tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:55.199623 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-bff011ef-7ba9-46d2-b7bd-e9fa446c3cff tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:55.201389 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-bff011ef-7ba9-46d2-b7bd-e9fa446c3cff tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:55.202663 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bff011ef-7ba9-46d2-b7bd-e9fa446c3cff tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1741 microversion: 2.20 time: 0.214733 Oct 01 04:23:55.203999 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 362/689] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:23:54 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1741 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:23:55.215432 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5af13fee-c26a-441a-b412-1df46e534478 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.070755 Oct 01 04:23:55.216116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 328/690] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 1 04:23:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 04:23:55.234024 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-367a8061-34a9-4224-b031-6896065709be tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:55.235016 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-367a8061-34a9-4224-b031-6896065709be tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 87cd0cbd-547d-4e0e-a797-7971ce307b17] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:55.293427 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-367a8061-34a9-4224-b031-6896065709be tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:55.301232 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-367a8061-34a9-4224-b031-6896065709be tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17" status: 200 len: 1095 microversion: 2.1 time: 0.075872 Oct 01 04:23:55.302213 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 363/691] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:55 2022] GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17 => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:23:56.230486 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4ad2694c-05df-4b93-bae8-a4c607e71257 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:56.231110 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4ad2694c-05df-4b93-bae8-a4c607e71257 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:56.242679 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ad2694c-05df-4b93-bae8-a4c607e71257 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:56.244326 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ad2694c-05df-4b93-bae8-a4c607e71257 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:56.244698 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ad2694c-05df-4b93-bae8-a4c607e71257 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:56.245460 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ad2694c-05df-4b93-bae8-a4c607e71257 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:56.245934 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ad2694c-05df-4b93-bae8-a4c607e71257 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:56.246374 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ad2694c-05df-4b93-bae8-a4c607e71257 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:56.326758 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-60b1153f-2ced-4971-a911-ae5d6284674a tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:56.327408 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-60b1153f-2ced-4971-a911-ae5d6284674a tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 87cd0cbd-547d-4e0e-a797-7971ce307b17] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:56.342581 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-60b1153f-2ced-4971-a911-ae5d6284674a tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:56.343078 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-60b1153f-2ced-4971-a911-ae5d6284674a tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:56.343517 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-60b1153f-2ced-4971-a911-ae5d6284674a tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:56.344271 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-60b1153f-2ced-4971-a911-ae5d6284674a tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:56.344732 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-60b1153f-2ced-4971-a911-ae5d6284674a tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:56.345182 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-60b1153f-2ced-4971-a911-ae5d6284674a tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:56.450351 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-4ad2694c-05df-4b93-bae8-a4c607e71257 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:56.459233 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-4ad2694c-05df-4b93-bae8-a4c607e71257 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:56.461027 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-4ad2694c-05df-4b93-bae8-a4c607e71257 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:56.462236 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4ad2694c-05df-4b93-bae8-a4c607e71257 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1741 microversion: 2.20 time: 0.236697 Oct 01 04:23:56.462843 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 329/692] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:23:56 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1741 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:23:56.469036 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-60b1153f-2ced-4971-a911-ae5d6284674a tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:56.478385 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-60b1153f-2ced-4971-a911-ae5d6284674a tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17" status: 200 len: 1193 microversion: 2.1 time: 0.155879 Oct 01 04:23:56.479025 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 364/693] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:56 2022] GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17 => generated 1193 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:23:57.489570 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ccbe76e2-4f7a-43b5-8f67-5110ceb142a7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:57.490201 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ccbe76e2-4f7a-43b5-8f67-5110ceb142a7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:57.506477 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3497f428-7364-4e7b-ac95-aa34447760e2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:57.507807 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3497f428-7364-4e7b-ac95-aa34447760e2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 87cd0cbd-547d-4e0e-a797-7971ce307b17] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:57.508233 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ccbe76e2-4f7a-43b5-8f67-5110ceb142a7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:57.509045 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ccbe76e2-4f7a-43b5-8f67-5110ceb142a7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:57.511344 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ccbe76e2-4f7a-43b5-8f67-5110ceb142a7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:57.513992 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ccbe76e2-4f7a-43b5-8f67-5110ceb142a7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:57.514674 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ccbe76e2-4f7a-43b5-8f67-5110ceb142a7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:57.518296 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3497f428-7364-4e7b-ac95-aa34447760e2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:57.518789 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3497f428-7364-4e7b-ac95-aa34447760e2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:57.519228 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3497f428-7364-4e7b-ac95-aa34447760e2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:57.519942 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3497f428-7364-4e7b-ac95-aa34447760e2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:57.520403 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3497f428-7364-4e7b-ac95-aa34447760e2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:57.520830 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3497f428-7364-4e7b-ac95-aa34447760e2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:57.521864 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ccbe76e2-4f7a-43b5-8f67-5110ceb142a7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:57.620869 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-3497f428-7364-4e7b-ac95-aa34447760e2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:57.629917 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3497f428-7364-4e7b-ac95-aa34447760e2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17" status: 200 len: 1211 microversion: 2.1 time: 0.130189 Oct 01 04:23:57.631076 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 365/694] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:57 2022] GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17 => generated 1211 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:23:57.747310 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-ccbe76e2-4f7a-43b5-8f67-5110ceb142a7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:57.757369 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-ccbe76e2-4f7a-43b5-8f67-5110ceb142a7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:57.758833 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-ccbe76e2-4f7a-43b5-8f67-5110ceb142a7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:57.760021 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ccbe76e2-4f7a-43b5-8f67-5110ceb142a7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1723 microversion: 2.20 time: 0.274543 Oct 01 04:23:57.760678 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 330/695] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:23:57 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:23:58.658361 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-76c39cef-18bb-4661-9783-425fa1043fb3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:58.659025 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-76c39cef-18bb-4661-9783-425fa1043fb3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 87cd0cbd-547d-4e0e-a797-7971ce307b17] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:58.667810 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76c39cef-18bb-4661-9783-425fa1043fb3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:58.668626 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76c39cef-18bb-4661-9783-425fa1043fb3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:58.669231 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76c39cef-18bb-4661-9783-425fa1043fb3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:58.670106 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76c39cef-18bb-4661-9783-425fa1043fb3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:58.670630 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76c39cef-18bb-4661-9783-425fa1043fb3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:58.671218 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76c39cef-18bb-4661-9783-425fa1043fb3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:58.793265 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bf668991-0887-4249-8fe9-65aa0130e214 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:58.794038 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bf668991-0887-4249-8fe9-65aa0130e214 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:58.801416 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf668991-0887-4249-8fe9-65aa0130e214 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:58.802352 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf668991-0887-4249-8fe9-65aa0130e214 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:58.802791 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf668991-0887-4249-8fe9-65aa0130e214 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:58.803726 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf668991-0887-4249-8fe9-65aa0130e214 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:58.805217 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf668991-0887-4249-8fe9-65aa0130e214 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:58.805671 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bf668991-0887-4249-8fe9-65aa0130e214 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:58.811877 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-76c39cef-18bb-4661-9783-425fa1043fb3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:58.820764 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-76c39cef-18bb-4661-9783-425fa1043fb3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17" status: 200 len: 1279 microversion: 2.1 time: 0.166275 Oct 01 04:23:58.821363 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 366/696] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:58 2022] GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17 => generated 1279 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:23:58.948558 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-bf668991-0887-4249-8fe9-65aa0130e214 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:58.950899 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:23:58.958057 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-bf668991-0887-4249-8fe9-65aa0130e214 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:58.959487 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-bf668991-0887-4249-8fe9-65aa0130e214 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:58.961406 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bf668991-0887-4249-8fe9-65aa0130e214 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1723 microversion: 2.20 time: 0.172396 Oct 01 04:23:58.961961 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 331/697] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:23:58 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:23:59.622561 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-37feb8e5-e756-4ffd-9bb3-c1e06169c4ee req-d511327b-5f1c-49bf-aac4-7239f77c09b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b21e7357-43a2-4dc9-b0f6-26b14b68c464", "name": "network-vif-unplugged", "status": "completed", "tag": "735577aa-5ec2-48d4-8f41-38cb8f95250a"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:23:59.632174 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-37feb8e5-e756-4ffd-9bb3-c1e06169c4ee req-d511327b-5f1c-49bf-aac4-7239f77c09b9 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:59.632670 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-37feb8e5-e756-4ffd-9bb3-c1e06169c4ee req-d511327b-5f1c-49bf-aac4-7239f77c09b9 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:59.633134 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-37feb8e5-e756-4ffd-9bb3-c1e06169c4ee req-d511327b-5f1c-49bf-aac4-7239f77c09b9 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:59.644372 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-37feb8e5-e756-4ffd-9bb3-c1e06169c4ee req-d511327b-5f1c-49bf-aac4-7239f77c09b9 service nova] Creating event network-vif-unplugged:735577aa-5ec2-48d4-8f41-38cb8f95250a for instance b21e7357-43a2-4dc9-b0f6-26b14b68c464 on hv-cinder-86004 Oct 01 04:23:59.649703 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-37feb8e5-e756-4ffd-9bb3-c1e06169c4ee req-d511327b-5f1c-49bf-aac4-7239f77c09b9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030790 Oct 01 04:23:59.650297 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 367/698] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:23:59.843181 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e62a7c50-4f08-4536-8397-1765034b923e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:59.843795 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e62a7c50-4f08-4536-8397-1765034b923e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 87cd0cbd-547d-4e0e-a797-7971ce307b17] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:59.852689 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e62a7c50-4f08-4536-8397-1765034b923e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:59.853212 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e62a7c50-4f08-4536-8397-1765034b923e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:59.853653 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e62a7c50-4f08-4536-8397-1765034b923e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:59.854350 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e62a7c50-4f08-4536-8397-1765034b923e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:59.854813 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e62a7c50-4f08-4536-8397-1765034b923e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:59.855244 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e62a7c50-4f08-4536-8397-1765034b923e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:23:59.988875 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7676975b-d48b-4be7-b6de-77456e1e22a3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:23:59.989687 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7676975b-d48b-4be7-b6de-77456e1e22a3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:23:59.995132 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-e62a7c50-4f08-4536-8397-1765034b923e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:23:59.998994 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7676975b-d48b-4be7-b6de-77456e1e22a3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:23:59.999490 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7676975b-d48b-4be7-b6de-77456e1e22a3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:23:59.999932 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7676975b-d48b-4be7-b6de-77456e1e22a3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:00.000639 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7676975b-d48b-4be7-b6de-77456e1e22a3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:00.001301 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7676975b-d48b-4be7-b6de-77456e1e22a3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:00.001731 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7676975b-d48b-4be7-b6de-77456e1e22a3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:00.004627 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e62a7c50-4f08-4536-8397-1765034b923e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17" status: 200 len: 1279 microversion: 2.1 time: 0.165267 Oct 01 04:24:00.017650 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 332/699] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:23:59 2022] GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17 => generated 1279 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:00.137802 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7676975b-d48b-4be7-b6de-77456e1e22a3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:00.145903 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7676975b-d48b-4be7-b6de-77456e1e22a3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:00.148409 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7676975b-d48b-4be7-b6de-77456e1e22a3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:00.149854 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7676975b-d48b-4be7-b6de-77456e1e22a3 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1723 microversion: 2.20 time: 0.165519 Oct 01 04:24:00.161163 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 368/700] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:23:59 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:24:00.709122 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-2423b777-b659-41c3-bebb-063adb5eed5a req-79ab90bd-9d90-480a-abe1-1c11704544f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87cd0cbd-547d-4e0e-a797-7971ce307b17", "tag": "998978bd-7095-4f80-b84b-5589f1d6add2"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:24:00.727465 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2423b777-b659-41c3-bebb-063adb5eed5a req-79ab90bd-9d90-480a-abe1-1c11704544f4 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:00.730439 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2423b777-b659-41c3-bebb-063adb5eed5a req-79ab90bd-9d90-480a-abe1-1c11704544f4 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:00.731308 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-2423b777-b659-41c3-bebb-063adb5eed5a req-79ab90bd-9d90-480a-abe1-1c11704544f4 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:00.744705 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-2423b777-b659-41c3-bebb-063adb5eed5a req-79ab90bd-9d90-480a-abe1-1c11704544f4 service nova] Creating event network-changed:998978bd-7095-4f80-b84b-5589f1d6add2 for instance 87cd0cbd-547d-4e0e-a797-7971ce307b17 on hv-cinder-86004 Oct 01 04:24:00.751347 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-2423b777-b659-41c3-bebb-063adb5eed5a req-79ab90bd-9d90-480a-abe1-1c11704544f4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047233 Oct 01 04:24:00.752556 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 333/701] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:24:01.028544 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3ccde8ce-8205-4413-87e3-854cf61c4030 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:01.029135 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3ccde8ce-8205-4413-87e3-854cf61c4030 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 87cd0cbd-547d-4e0e-a797-7971ce307b17] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:01.035509 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ccde8ce-8205-4413-87e3-854cf61c4030 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:01.035991 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ccde8ce-8205-4413-87e3-854cf61c4030 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:01.036425 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ccde8ce-8205-4413-87e3-854cf61c4030 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:01.037137 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ccde8ce-8205-4413-87e3-854cf61c4030 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:01.037594 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ccde8ce-8205-4413-87e3-854cf61c4030 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:01.038016 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3ccde8ce-8205-4413-87e3-854cf61c4030 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:01.178305 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6fde2d43-d102-4c6f-a10e-21c6df89049a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:01.179841 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6fde2d43-d102-4c6f-a10e-21c6df89049a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:01.183776 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-3ccde8ce-8205-4413-87e3-854cf61c4030 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:01.201820 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3ccde8ce-8205-4413-87e3-854cf61c4030 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17" status: 200 len: 1279 microversion: 2.1 time: 0.176870 Oct 01 04:24:01.209750 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 369/702] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:01 2022] GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17 => generated 1279 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:24:01.213361 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6fde2d43-d102-4c6f-a10e-21c6df89049a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:01.214078 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6fde2d43-d102-4c6f-a10e-21c6df89049a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:01.214699 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6fde2d43-d102-4c6f-a10e-21c6df89049a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:01.215428 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6fde2d43-d102-4c6f-a10e-21c6df89049a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:01.215901 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6fde2d43-d102-4c6f-a10e-21c6df89049a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:01.216343 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6fde2d43-d102-4c6f-a10e-21c6df89049a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:01.388944 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-6fde2d43-d102-4c6f-a10e-21c6df89049a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:01.399302 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-6fde2d43-d102-4c6f-a10e-21c6df89049a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:01.401909 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-6fde2d43-d102-4c6f-a10e-21c6df89049a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:01.404563 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6fde2d43-d102-4c6f-a10e-21c6df89049a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1666 microversion: 2.20 time: 0.232749 Oct 01 04:24:01.406050 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 334/703] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:24:01 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1666 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:24:01.431544 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5b5675ad-bdd7-4f4a-9fd7-c4cd66fcd9fb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09d18c54-4063-4ce3-9214-85dd7281b86b"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:24:01.434312 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5b5675ad-bdd7-4f4a-9fd7-c4cd66fcd9fb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:01.440776 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b5675ad-bdd7-4f4a-9fd7-c4cd66fcd9fb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:01.441512 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b5675ad-bdd7-4f4a-9fd7-c4cd66fcd9fb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:01.442150 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b5675ad-bdd7-4f4a-9fd7-c4cd66fcd9fb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:01.443104 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b5675ad-bdd7-4f4a-9fd7-c4cd66fcd9fb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:01.443771 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b5675ad-bdd7-4f4a-9fd7-c4cd66fcd9fb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:01.444432 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b5675ad-bdd7-4f4a-9fd7-c4cd66fcd9fb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:01.483222 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f7a29cbc-3d3d-4d72-b655-42656f98625d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:01.485742 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f7a29cbc-3d3d-4d72-b655-42656f98625d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:01.492228 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7a29cbc-3d3d-4d72-b655-42656f98625d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:01.492730 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7a29cbc-3d3d-4d72-b655-42656f98625d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:01.493196 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7a29cbc-3d3d-4d72-b655-42656f98625d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:01.493908 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7a29cbc-3d3d-4d72-b655-42656f98625d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:01.494437 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7a29cbc-3d3d-4d72-b655-42656f98625d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:01.494867 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f7a29cbc-3d3d-4d72-b655-42656f98625d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:01.536518 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f7a29cbc-3d3d-4d72-b655-42656f98625d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.057515 Oct 01 04:24:01.541010 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 335/704] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 1 04:24:01 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b/os-volume_attachments => generated 371 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:24:01.682796 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a00ed74e-3ca8-491b-985f-43754015b288 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:01.683294 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a00ed74e-3ca8-491b-985f-43754015b288 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:01.689246 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a00ed74e-3ca8-491b-985f-43754015b288 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:01.689739 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a00ed74e-3ca8-491b-985f-43754015b288 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:01.690180 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a00ed74e-3ca8-491b-985f-43754015b288 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:01.690881 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a00ed74e-3ca8-491b-985f-43754015b288 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:01.691348 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a00ed74e-3ca8-491b-985f-43754015b288 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:01.691775 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a00ed74e-3ca8-491b-985f-43754015b288 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:01.722037 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a00ed74e-3ca8-491b-985f-43754015b288 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b/os-volume_attachments/b6b4d7f0-3402-40ba-ad9a-0f3c791f6596" status: 200 len: 194 microversion: 2.1 time: 0.043410 Oct 01 04:24:01.722639 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 336/705] 10.222.0.26 () {58 vars in 1413 bytes} [Sat Oct 1 04:24:01 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b/os-volume_attachments/b6b4d7f0-3402-40ba-ad9a-0f3c791f6596 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:24:01.734589 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-57741f9e-6bab-41fb-aef3-4f9f1e519c8b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:01.735368 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-57741f9e-6bab-41fb-aef3-4f9f1e519c8b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:01.744176 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57741f9e-6bab-41fb-aef3-4f9f1e519c8b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:01.744677 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57741f9e-6bab-41fb-aef3-4f9f1e519c8b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:01.745155 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57741f9e-6bab-41fb-aef3-4f9f1e519c8b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:01.745886 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57741f9e-6bab-41fb-aef3-4f9f1e519c8b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:01.746332 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57741f9e-6bab-41fb-aef3-4f9f1e519c8b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:01.746794 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-57741f9e-6bab-41fb-aef3-4f9f1e519c8b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:01.749007 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5b5675ad-bdd7-4f4a-9fd7-c4cd66fcd9fb tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "POST /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.321449 Oct 01 04:24:01.749619 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 370/706] 10.222.0.26 () {62 vars in 1364 bytes} [Sat Oct 1 04:24:01 2022] POST /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464/os-volume_attachments => generated 188 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 01 04:24:01.832596 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-57741f9e-6bab-41fb-aef3-4f9f1e519c8b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lazy-loading 'services' on Instance uuid fe5ffc66-fce0-4d07-9190-6b4634a9047b {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:24:01.893342 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-341d3080-b655-4c3c-9009-d6c31e49019e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:01.894104 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-341d3080-b655-4c3c-9009-d6c31e49019e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:01.901504 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-341d3080-b655-4c3c-9009-d6c31e49019e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:01.902321 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-341d3080-b655-4c3c-9009-d6c31e49019e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:01.902935 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-341d3080-b655-4c3c-9009-d6c31e49019e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:01.903639 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-341d3080-b655-4c3c-9009-d6c31e49019e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:01.904095 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-341d3080-b655-4c3c-9009-d6c31e49019e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:01.904510 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-341d3080-b655-4c3c-9009-d6c31e49019e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:01.946190 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-57741f9e-6bab-41fb-aef3-4f9f1e519c8b tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b/os-volume_attachments/b6b4d7f0-3402-40ba-ad9a-0f3c791f6596" status: 202 len: 0 microversion: 2.1 time: 0.216154 Oct 01 04:24:01.951301 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 337/707] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 1 04:24:01 2022] DELETE /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b/os-volume_attachments/b6b4d7f0-3402-40ba-ad9a-0f3c791f6596 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 01 04:24:02.192566 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-341d3080-b655-4c3c-9009-d6c31e49019e tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464/os-volume_attachments/09d18c54-4063-4ce3-9214-85dd7281b86b" status: 202 len: 0 microversion: 2.20 time: 0.303080 Oct 01 04:24:02.193200 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 371/708] 10.222.0.26 () {60 vars in 1457 bytes} [Sat Oct 1 04:24:01 2022] DELETE /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464/os-volume_attachments/09d18c54-4063-4ce3-9214-85dd7281b86b => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 01 04:24:02.228692 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-137df429-e432-4847-a16c-a73d49d88101 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:02.229959 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-137df429-e432-4847-a16c-a73d49d88101 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 87cd0cbd-547d-4e0e-a797-7971ce307b17] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:02.237753 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-137df429-e432-4847-a16c-a73d49d88101 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:02.238256 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-137df429-e432-4847-a16c-a73d49d88101 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:02.238695 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-137df429-e432-4847-a16c-a73d49d88101 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:02.239574 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-137df429-e432-4847-a16c-a73d49d88101 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:02.240461 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-137df429-e432-4847-a16c-a73d49d88101 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:02.240898 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-137df429-e432-4847-a16c-a73d49d88101 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:02.264440 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e0249c4f-1af7-4bca-8bdf-4dc4c8618bae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:24:02.265166 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e0249c4f-1af7-4bca-8bdf-4dc4c8618bae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:02.271880 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0249c4f-1af7-4bca-8bdf-4dc4c8618bae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:02.272983 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0249c4f-1af7-4bca-8bdf-4dc4c8618bae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:02.273490 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0249c4f-1af7-4bca-8bdf-4dc4c8618bae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:02.274247 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0249c4f-1af7-4bca-8bdf-4dc4c8618bae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:02.274799 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0249c4f-1af7-4bca-8bdf-4dc4c8618bae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:02.275283 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0249c4f-1af7-4bca-8bdf-4dc4c8618bae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:02.384170 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e0249c4f-1af7-4bca-8bdf-4dc4c8618bae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120598) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 01 04:24:02.400745 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-137df429-e432-4847-a16c-a73d49d88101 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:02.410109 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-137df429-e432-4847-a16c-a73d49d88101 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17" status: 200 len: 1267 microversion: 2.1 time: 0.186161 Oct 01 04:24:02.411462 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 338/709] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:02 2022] GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17 => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:02.435098 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=5,nova_cell1:UPDATE=9 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:02.464977 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e0249c4f-1af7-4bca-8bdf-4dc4c8618bae tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "POST /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464/action" status: 202 len: 0 microversion: 2.20 time: 0.203614 Oct 01 04:24:02.465644 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 372/710] 10.222.0.26 () {62 vars in 1319 bytes} [Sat Oct 1 04:24:02 2022] POST /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 01 04:24:02.473928 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a557c19b-54b5-43c2-8092-e89a0d8c4553 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:02.475577 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a557c19b-54b5-43c2-8092-e89a0d8c4553 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:02.483102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a557c19b-54b5-43c2-8092-e89a0d8c4553 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:02.483715 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a557c19b-54b5-43c2-8092-e89a0d8c4553 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:02.484383 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a557c19b-54b5-43c2-8092-e89a0d8c4553 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:02.485546 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a557c19b-54b5-43c2-8092-e89a0d8c4553 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:02.486628 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a557c19b-54b5-43c2-8092-e89a0d8c4553 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:02.487300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a557c19b-54b5-43c2-8092-e89a0d8c4553 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:02.705875 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-a557c19b-54b5-43c2-8092-e89a0d8c4553 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:02.727172 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-a557c19b-54b5-43c2-8092-e89a0d8c4553 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:02.729022 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-a557c19b-54b5-43c2-8092-e89a0d8c4553 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:02.730243 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a557c19b-54b5-43c2-8092-e89a0d8c4553 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1674 microversion: 2.20 time: 0.260800 Oct 01 04:24:02.734845 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 339/711] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:24:02 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1674 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:24:03.102061 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-686f6845-1da8-4ae0-83d0-cbc69b49e6f1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:03.102523 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-686f6845-1da8-4ae0-83d0-cbc69b49e6f1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:03.109033 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-686f6845-1da8-4ae0-83d0-cbc69b49e6f1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:03.109646 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-686f6845-1da8-4ae0-83d0-cbc69b49e6f1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:03.109945 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-686f6845-1da8-4ae0-83d0-cbc69b49e6f1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:03.110664 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-686f6845-1da8-4ae0-83d0-cbc69b49e6f1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:03.111177 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-686f6845-1da8-4ae0-83d0-cbc69b49e6f1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:03.111599 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-686f6845-1da8-4ae0-83d0-cbc69b49e6f1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:03.160709 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-686f6845-1da8-4ae0-83d0-cbc69b49e6f1 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b/os-volume_attachments/d6e7d7d6-6182-4abf-bbe6-db27c32cadf3" status: 200 len: 194 microversion: 2.1 time: 0.063370 Oct 01 04:24:03.161334 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 373/712] 10.222.0.26 () {58 vars in 1413 bytes} [Sat Oct 1 04:24:03 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b/os-volume_attachments/d6e7d7d6-6182-4abf-bbe6-db27c32cadf3 => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:24:03.173116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-71632fe0-4147-4e0d-83ac-c53ef9857a88 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:03.173845 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-71632fe0-4147-4e0d-83ac-c53ef9857a88 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:03.180878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71632fe0-4147-4e0d-83ac-c53ef9857a88 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:03.181404 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71632fe0-4147-4e0d-83ac-c53ef9857a88 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:03.181847 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71632fe0-4147-4e0d-83ac-c53ef9857a88 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:03.182561 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71632fe0-4147-4e0d-83ac-c53ef9857a88 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:03.183035 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71632fe0-4147-4e0d-83ac-c53ef9857a88 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:03.183444 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71632fe0-4147-4e0d-83ac-c53ef9857a88 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:03.284282 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-71632fe0-4147-4e0d-83ac-c53ef9857a88 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lazy-loading 'services' on Instance uuid fe5ffc66-fce0-4d07-9190-6b4634a9047b {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:24:03.375220 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-71632fe0-4147-4e0d-83ac-c53ef9857a88 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b/os-volume_attachments/d6e7d7d6-6182-4abf-bbe6-db27c32cadf3" status: 202 len: 0 microversion: 2.1 time: 0.205640 Oct 01 04:24:03.376035 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 340/713] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 1 04:24:03 2022] DELETE /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b/os-volume_attachments/d6e7d7d6-6182-4abf-bbe6-db27c32cadf3 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 01 04:24:03.435408 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-15d6459b-fc98-4b90-9654-f3634f1a4b41 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:03.437128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-15d6459b-fc98-4b90-9654-f3634f1a4b41 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 87cd0cbd-547d-4e0e-a797-7971ce307b17] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:03.445238 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15d6459b-fc98-4b90-9654-f3634f1a4b41 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:03.446020 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15d6459b-fc98-4b90-9654-f3634f1a4b41 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:03.446533 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15d6459b-fc98-4b90-9654-f3634f1a4b41 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:03.447202 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15d6459b-fc98-4b90-9654-f3634f1a4b41 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:03.447661 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15d6459b-fc98-4b90-9654-f3634f1a4b41 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:03.448234 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-15d6459b-fc98-4b90-9654-f3634f1a4b41 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:03.619176 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-15d6459b-fc98-4b90-9654-f3634f1a4b41 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:03.626943 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-15d6459b-fc98-4b90-9654-f3634f1a4b41 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17" status: 200 len: 1267 microversion: 2.1 time: 0.197951 Oct 01 04:24:03.627498 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 374/714] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:03 2022] GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17 => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:03.756311 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-aaa4c466-bb0d-4ad5-a90e-28552e39a4d8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:03.757354 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-aaa4c466-bb0d-4ad5-a90e-28552e39a4d8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:03.763966 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aaa4c466-bb0d-4ad5-a90e-28552e39a4d8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:03.764476 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aaa4c466-bb0d-4ad5-a90e-28552e39a4d8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:03.764920 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aaa4c466-bb0d-4ad5-a90e-28552e39a4d8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:03.765953 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aaa4c466-bb0d-4ad5-a90e-28552e39a4d8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:03.766100 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aaa4c466-bb0d-4ad5-a90e-28552e39a4d8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:03.766557 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aaa4c466-bb0d-4ad5-a90e-28552e39a4d8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:03.933162 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-aaa4c466-bb0d-4ad5-a90e-28552e39a4d8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:03.943817 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-aaa4c466-bb0d-4ad5-a90e-28552e39a4d8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:03.946474 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-aaa4c466-bb0d-4ad5-a90e-28552e39a4d8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:03.947851 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-aaa4c466-bb0d-4ad5-a90e-28552e39a4d8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1674 microversion: 2.20 time: 0.195800 Oct 01 04:24:03.948445 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 341/715] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:24:03 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1674 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:24:04.598132 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c2858077-4b5d-4814-85c2-a09626910725 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:04.600416 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c2858077-4b5d-4814-85c2-a09626910725 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:04.607372 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2858077-4b5d-4814-85c2-a09626910725 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:04.607857 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2858077-4b5d-4814-85c2-a09626910725 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:04.608293 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2858077-4b5d-4814-85c2-a09626910725 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:04.609010 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2858077-4b5d-4814-85c2-a09626910725 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:04.609469 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2858077-4b5d-4814-85c2-a09626910725 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:04.609891 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c2858077-4b5d-4814-85c2-a09626910725 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:04.639202 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c2858077-4b5d-4814-85c2-a09626910725 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044984 Oct 01 04:24:04.639992 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 375/716] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 1 04:24:04 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 04:24:04.651182 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2551947c-cf9a-4c9d-828d-c0f3defa2a28 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:04.651905 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2551947c-cf9a-4c9d-828d-c0f3defa2a28 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 87cd0cbd-547d-4e0e-a797-7971ce307b17] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:04.654511 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:04.660094 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2551947c-cf9a-4c9d-828d-c0f3defa2a28 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:04.660795 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2551947c-cf9a-4c9d-828d-c0f3defa2a28 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:04.661264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2551947c-cf9a-4c9d-828d-c0f3defa2a28 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:04.661971 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2551947c-cf9a-4c9d-828d-c0f3defa2a28 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:04.662647 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2551947c-cf9a-4c9d-828d-c0f3defa2a28 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:04.663127 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2551947c-cf9a-4c9d-828d-c0f3defa2a28 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:04.765287 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e6fce02e-9a03-4013-98b3-516ef7a7a312 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:04.767518 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e6fce02e-9a03-4013-98b3-516ef7a7a312 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:04.775568 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6fce02e-9a03-4013-98b3-516ef7a7a312 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:04.776065 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6fce02e-9a03-4013-98b3-516ef7a7a312 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:04.776507 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6fce02e-9a03-4013-98b3-516ef7a7a312 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:04.777239 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6fce02e-9a03-4013-98b3-516ef7a7a312 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:04.777885 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6fce02e-9a03-4013-98b3-516ef7a7a312 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:04.778314 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e6fce02e-9a03-4013-98b3-516ef7a7a312 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:04.813114 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-2551947c-cf9a-4c9d-828d-c0f3defa2a28 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:04.815336 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e6fce02e-9a03-4013-98b3-516ef7a7a312 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053997 Oct 01 04:24:04.815956 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 376/717] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 1 04:24:04 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 01 04:24:04.823304 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2551947c-cf9a-4c9d-828d-c0f3defa2a28 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17" status: 200 len: 1267 microversion: 2.1 time: 0.176978 Oct 01 04:24:04.824133 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 342/718] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:04 2022] GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:04.893628 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-02e85a5f-647f-42c8-ac43-11d199e194b3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:04.894123 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-02e85a5f-647f-42c8-ac43-11d199e194b3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:04.900778 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02e85a5f-647f-42c8-ac43-11d199e194b3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:04.901300 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02e85a5f-647f-42c8-ac43-11d199e194b3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:04.901739 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02e85a5f-647f-42c8-ac43-11d199e194b3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:04.902437 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02e85a5f-647f-42c8-ac43-11d199e194b3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:04.902895 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02e85a5f-647f-42c8-ac43-11d199e194b3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:04.903322 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-02e85a5f-647f-42c8-ac43-11d199e194b3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:04.929264 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-02e85a5f-647f-42c8-ac43-11d199e194b3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 04:24:04.975854 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1217e4a0-b2fd-412a-bd54-fe8728f0d8ec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:04.976529 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1217e4a0-b2fd-412a-bd54-fe8728f0d8ec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:04.978629 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:04.979820 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:04.985999 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1217e4a0-b2fd-412a-bd54-fe8728f0d8ec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:04.986546 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1217e4a0-b2fd-412a-bd54-fe8728f0d8ec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:04.987015 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1217e4a0-b2fd-412a-bd54-fe8728f0d8ec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:04.987769 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1217e4a0-b2fd-412a-bd54-fe8728f0d8ec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:04.988230 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1217e4a0-b2fd-412a-bd54-fe8728f0d8ec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:04.988654 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1217e4a0-b2fd-412a-bd54-fe8728f0d8ec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:05.009900 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-02e85a5f-647f-42c8-ac43-11d199e194b3 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b" status: 204 len: 0 microversion: 2.1 time: 0.119415 Oct 01 04:24:05.010734 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 377/719] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 1 04:24:04 2022] DELETE /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 04:24:05.019658 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-de1ff027-fc90-4e64-8f8f-48dce6de0d57 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:05.020397 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-de1ff027-fc90-4e64-8f8f-48dce6de0d57 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:05.026624 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de1ff027-fc90-4e64-8f8f-48dce6de0d57 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:05.027122 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de1ff027-fc90-4e64-8f8f-48dce6de0d57 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:05.027568 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de1ff027-fc90-4e64-8f8f-48dce6de0d57 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:05.028281 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de1ff027-fc90-4e64-8f8f-48dce6de0d57 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:05.028743 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de1ff027-fc90-4e64-8f8f-48dce6de0d57 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:05.029199 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-de1ff027-fc90-4e64-8f8f-48dce6de0d57 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:05.177903 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-1217e4a0-b2fd-412a-bd54-fe8728f0d8ec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:05.187447 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-1217e4a0-b2fd-412a-bd54-fe8728f0d8ec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:05.188881 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-1217e4a0-b2fd-412a-bd54-fe8728f0d8ec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:05.190104 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1217e4a0-b2fd-412a-bd54-fe8728f0d8ec tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1732 microversion: 2.20 time: 0.218389 Oct 01 04:24:05.190667 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 343/720] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:24:04 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1732 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:24:05.215892 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-de1ff027-fc90-4e64-8f8f-48dce6de0d57 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:05.224396 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-de1ff027-fc90-4e64-8f8f-48dce6de0d57 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b" status: 200 len: 1674 microversion: 2.1 time: 0.209285 Oct 01 04:24:05.224998 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 378/721] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:05 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b => generated 1674 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:05.851664 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5793f715-5e4e-4ab8-81b0-57520fd12754 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:05.852311 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5793f715-5e4e-4ab8-81b0-57520fd12754 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 87cd0cbd-547d-4e0e-a797-7971ce307b17] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:05.859019 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5793f715-5e4e-4ab8-81b0-57520fd12754 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:05.859813 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5793f715-5e4e-4ab8-81b0-57520fd12754 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:05.860254 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5793f715-5e4e-4ab8-81b0-57520fd12754 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:05.861054 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5793f715-5e4e-4ab8-81b0-57520fd12754 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:05.861768 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5793f715-5e4e-4ab8-81b0-57520fd12754 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:05.862240 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5793f715-5e4e-4ab8-81b0-57520fd12754 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:05.992049 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-5793f715-5e4e-4ab8-81b0-57520fd12754 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:05.999712 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5793f715-5e4e-4ab8-81b0-57520fd12754 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17" status: 200 len: 1267 microversion: 2.1 time: 0.152912 Oct 01 04:24:06.000282 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 344/722] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:05 2022] GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:06.219317 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-49d667e3-4d81-4aa4-9b5f-e218c17812e4 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:06.220012 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-49d667e3-4d81-4aa4-9b5f-e218c17812e4 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:06.222145 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:06.228519 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49d667e3-4d81-4aa4-9b5f-e218c17812e4 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:06.229035 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49d667e3-4d81-4aa4-9b5f-e218c17812e4 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:06.229475 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49d667e3-4d81-4aa4-9b5f-e218c17812e4 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:06.230168 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49d667e3-4d81-4aa4-9b5f-e218c17812e4 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:06.230626 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49d667e3-4d81-4aa4-9b5f-e218c17812e4 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:06.231051 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-49d667e3-4d81-4aa4-9b5f-e218c17812e4 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:06.247680 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-33cdbf3e-5eb3-454d-bfe1-05ee75cca703 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:06.248297 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-33cdbf3e-5eb3-454d-bfe1-05ee75cca703 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:06.254181 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33cdbf3e-5eb3-454d-bfe1-05ee75cca703 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:06.254671 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33cdbf3e-5eb3-454d-bfe1-05ee75cca703 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:06.255109 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33cdbf3e-5eb3-454d-bfe1-05ee75cca703 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:06.255804 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33cdbf3e-5eb3-454d-bfe1-05ee75cca703 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:06.256265 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33cdbf3e-5eb3-454d-bfe1-05ee75cca703 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:06.257296 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-33cdbf3e-5eb3-454d-bfe1-05ee75cca703 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:06.455142 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-49d667e3-4d81-4aa4-9b5f-e218c17812e4 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:06.458377 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-33cdbf3e-5eb3-454d-bfe1-05ee75cca703 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:06.464158 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-49d667e3-4d81-4aa4-9b5f-e218c17812e4 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:06.465639 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-49d667e3-4d81-4aa4-9b5f-e218c17812e4 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:06.466796 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-49d667e3-4d81-4aa4-9b5f-e218c17812e4 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1732 microversion: 2.20 time: 0.253046 Oct 01 04:24:06.467140 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-33cdbf3e-5eb3-454d-bfe1-05ee75cca703 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b" status: 200 len: 1674 microversion: 2.1 time: 0.223290 Oct 01 04:24:06.467341 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 379/723] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:24:06 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1732 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:24:06.469011 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 345/724] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:06 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b => generated 1674 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:24:07.023284 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-13a6a6ad-5e8e-4c33-a9f3-1687c74f38ed tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:07.024186 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-13a6a6ad-5e8e-4c33-a9f3-1687c74f38ed tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 87cd0cbd-547d-4e0e-a797-7971ce307b17] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:07.033274 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13a6a6ad-5e8e-4c33-a9f3-1687c74f38ed tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:07.037282 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13a6a6ad-5e8e-4c33-a9f3-1687c74f38ed tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:07.038616 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13a6a6ad-5e8e-4c33-a9f3-1687c74f38ed tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:07.039792 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13a6a6ad-5e8e-4c33-a9f3-1687c74f38ed tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:07.040024 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13a6a6ad-5e8e-4c33-a9f3-1687c74f38ed tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:07.040457 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-13a6a6ad-5e8e-4c33-a9f3-1687c74f38ed tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:07.205457 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-13a6a6ad-5e8e-4c33-a9f3-1687c74f38ed tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:07.214481 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-13a6a6ad-5e8e-4c33-a9f3-1687c74f38ed tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17" status: 200 len: 1267 microversion: 2.1 time: 0.195602 Oct 01 04:24:07.215075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 380/725] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:07 2022] GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17 => generated 1267 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:07.492920 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bdc9029c-67cc-409c-b9a9-8a07ca777c20 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:07.493680 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bdc9029c-67cc-409c-b9a9-8a07ca777c20 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:07.494901 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-91e20a1f-3c9b-488d-9fd9-ddb5e1adc83d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:07.495527 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-91e20a1f-3c9b-488d-9fd9-ddb5e1adc83d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:07.512106 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bdc9029c-67cc-409c-b9a9-8a07ca777c20 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:07.512790 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bdc9029c-67cc-409c-b9a9-8a07ca777c20 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:07.513499 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bdc9029c-67cc-409c-b9a9-8a07ca777c20 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:07.514432 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bdc9029c-67cc-409c-b9a9-8a07ca777c20 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:07.515105 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bdc9029c-67cc-409c-b9a9-8a07ca777c20 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:07.515801 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bdc9029c-67cc-409c-b9a9-8a07ca777c20 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:07.524994 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91e20a1f-3c9b-488d-9fd9-ddb5e1adc83d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:07.525446 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91e20a1f-3c9b-488d-9fd9-ddb5e1adc83d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:07.526058 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91e20a1f-3c9b-488d-9fd9-ddb5e1adc83d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:07.526925 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91e20a1f-3c9b-488d-9fd9-ddb5e1adc83d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:07.527546 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91e20a1f-3c9b-488d-9fd9-ddb5e1adc83d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:07.528151 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91e20a1f-3c9b-488d-9fd9-ddb5e1adc83d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:07.678097 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-bdc9029c-67cc-409c-b9a9-8a07ca777c20 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:07.686943 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bdc9029c-67cc-409c-b9a9-8a07ca777c20 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b" status: 200 len: 1606 microversion: 2.1 time: 0.200233 Oct 01 04:24:07.691524 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 346/726] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:07 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b => generated 1606 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:07.805914 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-91e20a1f-3c9b-488d-9fd9-ddb5e1adc83d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:07.819683 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-91e20a1f-3c9b-488d-9fd9-ddb5e1adc83d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:07.824012 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-91e20a1f-3c9b-488d-9fd9-ddb5e1adc83d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:07.825744 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-91e20a1f-3c9b-488d-9fd9-ddb5e1adc83d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1732 microversion: 2.20 time: 0.336581 Oct 01 04:24:07.826917 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 381/727] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:24:07 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1732 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:24:08.210870 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-98fca81c-9c40-49f7-8e5b-6f3ba869f4f6 req-ad6c6f30-7880-4f9e-9a91-2dc2e4505bfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe5ffc66-fce0-4d07-9190-6b4634a9047b", "name": "network-vif-deleted", "tag": "b87ca074-d876-4fb1-9848-b40704e5a030"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:24:08.237853 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-98fca81c-9c40-49f7-8e5b-6f3ba869f4f6 req-ad6c6f30-7880-4f9e-9a91-2dc2e4505bfe service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:08.240139 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-98fca81c-9c40-49f7-8e5b-6f3ba869f4f6 req-ad6c6f30-7880-4f9e-9a91-2dc2e4505bfe service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:08.240352 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-32da975d-db52-4c7e-bb8d-7c460dea31e8 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:08.241049 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-98fca81c-9c40-49f7-8e5b-6f3ba869f4f6 req-ad6c6f30-7880-4f9e-9a91-2dc2e4505bfe service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:08.241268 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-32da975d-db52-4c7e-bb8d-7c460dea31e8 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 87cd0cbd-547d-4e0e-a797-7971ce307b17] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:08.252642 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32da975d-db52-4c7e-bb8d-7c460dea31e8 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:08.253412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32da975d-db52-4c7e-bb8d-7c460dea31e8 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:08.253997 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32da975d-db52-4c7e-bb8d-7c460dea31e8 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:08.260336 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32da975d-db52-4c7e-bb8d-7c460dea31e8 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:08.262713 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-98fca81c-9c40-49f7-8e5b-6f3ba869f4f6 req-ad6c6f30-7880-4f9e-9a91-2dc2e4505bfe service nova] Creating event network-vif-deleted:b87ca074-d876-4fb1-9848-b40704e5a030 for instance fe5ffc66-fce0-4d07-9190-6b4634a9047b on hv-cinder-86004 Oct 01 04:24:08.263459 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32da975d-db52-4c7e-bb8d-7c460dea31e8 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:08.264057 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-32da975d-db52-4c7e-bb8d-7c460dea31e8 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:08.290019 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-98fca81c-9c40-49f7-8e5b-6f3ba869f4f6 req-ad6c6f30-7880-4f9e-9a91-2dc2e4505bfe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065709 Oct 01 04:24:08.291294 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 347/728] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:24:08.495620 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-32da975d-db52-4c7e-bb8d-7c460dea31e8 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:08.504911 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-32da975d-db52-4c7e-bb8d-7c460dea31e8 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17" status: 200 len: 1267 microversion: 2.1 time: 0.268898 Oct 01 04:24:08.505519 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 382/729] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:08 2022] GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17 => generated 1267 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:08.717670 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c19fb566-ed26-43c7-afc1-a28666a65cec tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:08.718565 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c19fb566-ed26-43c7-afc1-a28666a65cec tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:08.736153 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c19fb566-ed26-43c7-afc1-a28666a65cec tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:08.737200 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c19fb566-ed26-43c7-afc1-a28666a65cec tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:08.737927 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c19fb566-ed26-43c7-afc1-a28666a65cec tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:08.742587 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c19fb566-ed26-43c7-afc1-a28666a65cec tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:08.742791 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c19fb566-ed26-43c7-afc1-a28666a65cec tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:08.743250 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c19fb566-ed26-43c7-afc1-a28666a65cec tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:08.776091 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:08.853740 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0300a7ee-8d58-4aa1-9585-2d618c9d81f5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:08.854354 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0300a7ee-8d58-4aa1-9585-2d618c9d81f5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:08.862580 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0300a7ee-8d58-4aa1-9585-2d618c9d81f5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:08.863070 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0300a7ee-8d58-4aa1-9585-2d618c9d81f5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:08.863317 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c19fb566-ed26-43c7-afc1-a28666a65cec tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:08.869607 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0300a7ee-8d58-4aa1-9585-2d618c9d81f5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:08.870610 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0300a7ee-8d58-4aa1-9585-2d618c9d81f5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:08.871277 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0300a7ee-8d58-4aa1-9585-2d618c9d81f5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:08.871876 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0300a7ee-8d58-4aa1-9585-2d618c9d81f5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:08.873067 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c19fb566-ed26-43c7-afc1-a28666a65cec tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b" status: 200 len: 1606 microversion: 2.1 time: 0.160892 Oct 01 04:24:08.873668 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 348/730] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:08 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b => generated 1606 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:09.088745 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0300a7ee-8d58-4aa1-9585-2d618c9d81f5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:09.104741 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0300a7ee-8d58-4aa1-9585-2d618c9d81f5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:09.106297 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0300a7ee-8d58-4aa1-9585-2d618c9d81f5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:09.107489 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0300a7ee-8d58-4aa1-9585-2d618c9d81f5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1732 microversion: 2.20 time: 0.258391 Oct 01 04:24:09.108057 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 383/731] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:24:08 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1732 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:24:09.528566 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bb14c2ea-6f06-4ee3-8a44-f686b97bfd0f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:09.529507 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bb14c2ea-6f06-4ee3-8a44-f686b97bfd0f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 87cd0cbd-547d-4e0e-a797-7971ce307b17] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:09.540036 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb14c2ea-6f06-4ee3-8a44-f686b97bfd0f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:09.540757 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb14c2ea-6f06-4ee3-8a44-f686b97bfd0f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:09.541394 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb14c2ea-6f06-4ee3-8a44-f686b97bfd0f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:09.542281 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb14c2ea-6f06-4ee3-8a44-f686b97bfd0f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:09.542912 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb14c2ea-6f06-4ee3-8a44-f686b97bfd0f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:09.543505 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bb14c2ea-6f06-4ee3-8a44-f686b97bfd0f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:09.728452 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-bb14c2ea-6f06-4ee3-8a44-f686b97bfd0f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:09.739889 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bb14c2ea-6f06-4ee3-8a44-f686b97bfd0f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17" status: 200 len: 1267 microversion: 2.1 time: 0.215548 Oct 01 04:24:09.752956 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 349/732] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:09 2022] GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17 => generated 1267 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:09.901981 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-aaec13a5-b0cc-4f95-aaa5-dba9d0cbc314 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:09.903739 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-aaec13a5-b0cc-4f95-aaa5-dba9d0cbc314 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:09.911157 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaec13a5-b0cc-4f95-aaa5-dba9d0cbc314 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:09.911919 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaec13a5-b0cc-4f95-aaa5-dba9d0cbc314 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:09.912522 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaec13a5-b0cc-4f95-aaa5-dba9d0cbc314 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:09.913976 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaec13a5-b0cc-4f95-aaa5-dba9d0cbc314 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:09.914606 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaec13a5-b0cc-4f95-aaa5-dba9d0cbc314 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:09.915192 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-aaec13a5-b0cc-4f95-aaa5-dba9d0cbc314 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:10.009078 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-aaec13a5-b0cc-4f95-aaa5-dba9d0cbc314 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:10.018681 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-aaec13a5-b0cc-4f95-aaa5-dba9d0cbc314 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b" status: 200 len: 1606 microversion: 2.1 time: 0.122067 Oct 01 04:24:10.019743 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 384/733] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:09 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b => generated 1606 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:10.138401 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-504aa388-d60c-4d95-903b-86e5d8b058b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:10.138970 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-504aa388-d60c-4d95-903b-86e5d8b058b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:10.145309 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-504aa388-d60c-4d95-903b-86e5d8b058b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:10.146298 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-504aa388-d60c-4d95-903b-86e5d8b058b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:10.146889 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-504aa388-d60c-4d95-903b-86e5d8b058b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:10.147838 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-504aa388-d60c-4d95-903b-86e5d8b058b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:10.148450 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-504aa388-d60c-4d95-903b-86e5d8b058b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:10.149058 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-504aa388-d60c-4d95-903b-86e5d8b058b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:10.407126 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-504aa388-d60c-4d95-903b-86e5d8b058b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:10.426782 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-504aa388-d60c-4d95-903b-86e5d8b058b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:10.428675 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-504aa388-d60c-4d95-903b-86e5d8b058b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:10.430475 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-504aa388-d60c-4d95-903b-86e5d8b058b0 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1732 microversion: 2.20 time: 0.295991 Oct 01 04:24:10.431858 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 350/734] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:24:10 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1732 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:24:10.769526 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7ba2ccca-48a5-4143-87b7-222984ecf425 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:10.769526 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7ba2ccca-48a5-4143-87b7-222984ecf425 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 87cd0cbd-547d-4e0e-a797-7971ce307b17] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:10.776780 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ba2ccca-48a5-4143-87b7-222984ecf425 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:10.777479 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ba2ccca-48a5-4143-87b7-222984ecf425 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:10.777943 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ba2ccca-48a5-4143-87b7-222984ecf425 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:10.778651 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ba2ccca-48a5-4143-87b7-222984ecf425 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:10.779120 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ba2ccca-48a5-4143-87b7-222984ecf425 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:10.779554 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ba2ccca-48a5-4143-87b7-222984ecf425 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:10.944951 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7ba2ccca-48a5-4143-87b7-222984ecf425 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:10.950625 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7ba2ccca-48a5-4143-87b7-222984ecf425 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17" status: 200 len: 1267 microversion: 2.1 time: 0.186061 Oct 01 04:24:10.951668 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 385/735] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:10 2022] GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17 => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:11.047850 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-35531ce3-0dad-4f8d-9a9f-ed5852a2246d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:11.048766 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-35531ce3-0dad-4f8d-9a9f-ed5852a2246d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:11.056590 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-35531ce3-0dad-4f8d-9a9f-ed5852a2246d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:11.057007 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-35531ce3-0dad-4f8d-9a9f-ed5852a2246d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:11.057451 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-35531ce3-0dad-4f8d-9a9f-ed5852a2246d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:11.058154 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-35531ce3-0dad-4f8d-9a9f-ed5852a2246d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:11.058638 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-35531ce3-0dad-4f8d-9a9f-ed5852a2246d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:11.059219 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-35531ce3-0dad-4f8d-9a9f-ed5852a2246d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:11.124078 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-35531ce3-0dad-4f8d-9a9f-ed5852a2246d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:11.133150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-35531ce3-0dad-4f8d-9a9f-ed5852a2246d tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b" status: 200 len: 1606 microversion: 2.1 time: 0.088637 Oct 01 04:24:11.148626 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 351/736] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:11 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b => generated 1606 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:11.461154 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a9d484d8-57a5-44fe-bb6b-6a2ef414ea24 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:11.467635 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a9d484d8-57a5-44fe-bb6b-6a2ef414ea24 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:11.475190 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9d484d8-57a5-44fe-bb6b-6a2ef414ea24 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:11.476236 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9d484d8-57a5-44fe-bb6b-6a2ef414ea24 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:11.476841 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9d484d8-57a5-44fe-bb6b-6a2ef414ea24 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:11.477964 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9d484d8-57a5-44fe-bb6b-6a2ef414ea24 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:11.478818 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9d484d8-57a5-44fe-bb6b-6a2ef414ea24 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:11.479457 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9d484d8-57a5-44fe-bb6b-6a2ef414ea24 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:11.650650 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a9d484d8-57a5-44fe-bb6b-6a2ef414ea24 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:11.668945 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a9d484d8-57a5-44fe-bb6b-6a2ef414ea24 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:11.670816 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a9d484d8-57a5-44fe-bb6b-6a2ef414ea24 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:11.672199 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a9d484d8-57a5-44fe-bb6b-6a2ef414ea24 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1732 microversion: 2.20 time: 0.217042 Oct 01 04:24:11.673353 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 386/737] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:24:11 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1732 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:24:11.765608 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-35cc6ec1-616c-4ed1-a8fe-f7700e13aa36 req-1d9d54b9-a88e-4238-8397-592e607bbb5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87cd0cbd-547d-4e0e-a797-7971ce307b17", "name": "network-vif-plugged", "status": "completed", "tag": "998978bd-7095-4f80-b84b-5589f1d6add2"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:24:11.778753 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-35cc6ec1-616c-4ed1-a8fe-f7700e13aa36 req-1d9d54b9-a88e-4238-8397-592e607bbb5c service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:11.779245 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-35cc6ec1-616c-4ed1-a8fe-f7700e13aa36 req-1d9d54b9-a88e-4238-8397-592e607bbb5c service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:11.779685 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-35cc6ec1-616c-4ed1-a8fe-f7700e13aa36 req-1d9d54b9-a88e-4238-8397-592e607bbb5c service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:11.790797 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-35cc6ec1-616c-4ed1-a8fe-f7700e13aa36 req-1d9d54b9-a88e-4238-8397-592e607bbb5c service nova] Creating event network-vif-plugged:998978bd-7095-4f80-b84b-5589f1d6add2 for instance 87cd0cbd-547d-4e0e-a797-7971ce307b17 on hv-cinder-86004 Oct 01 04:24:11.795878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-35cc6ec1-616c-4ed1-a8fe-f7700e13aa36 req-1d9d54b9-a88e-4238-8397-592e607bbb5c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035233 Oct 01 04:24:11.796475 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 352/738] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:24:11.974011 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-afdbf18c-f21e-4dbc-befa-b682e419f03d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:11.974628 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-afdbf18c-f21e-4dbc-befa-b682e419f03d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 87cd0cbd-547d-4e0e-a797-7971ce307b17] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:11.981642 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afdbf18c-f21e-4dbc-befa-b682e419f03d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:11.982060 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afdbf18c-f21e-4dbc-befa-b682e419f03d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:11.982492 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afdbf18c-f21e-4dbc-befa-b682e419f03d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:11.983206 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afdbf18c-f21e-4dbc-befa-b682e419f03d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:11.983668 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afdbf18c-f21e-4dbc-befa-b682e419f03d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:11.984097 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-afdbf18c-f21e-4dbc-befa-b682e419f03d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:12.000714 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:12.142571 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-afdbf18c-f21e-4dbc-befa-b682e419f03d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:12.150575 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-afdbf18c-f21e-4dbc-befa-b682e419f03d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17" status: 200 len: 1267 microversion: 2.1 time: 0.180404 Oct 01 04:24:12.151157 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 387/739] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:11 2022] GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:12.160059 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8ab9ff92-5836-4da6-9600-e22fb4ffcad7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:12.162468 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8ab9ff92-5836-4da6-9600-e22fb4ffcad7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:12.171034 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ab9ff92-5836-4da6-9600-e22fb4ffcad7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:12.171528 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ab9ff92-5836-4da6-9600-e22fb4ffcad7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:12.171965 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ab9ff92-5836-4da6-9600-e22fb4ffcad7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:12.172855 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ab9ff92-5836-4da6-9600-e22fb4ffcad7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:12.173358 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ab9ff92-5836-4da6-9600-e22fb4ffcad7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:12.173790 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8ab9ff92-5836-4da6-9600-e22fb4ffcad7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:12.263381 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-8ab9ff92-5836-4da6-9600-e22fb4ffcad7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:12.276825 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8ab9ff92-5836-4da6-9600-e22fb4ffcad7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b" status: 200 len: 1606 microversion: 2.1 time: 0.122520 Oct 01 04:24:12.277835 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 353/740] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:12 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b => generated 1606 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:12.704248 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5b755846-9750-4c8d-9fe7-9c95f581e21d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:12.704898 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5b755846-9750-4c8d-9fe7-9c95f581e21d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:12.711651 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b755846-9750-4c8d-9fe7-9c95f581e21d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:12.712796 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b755846-9750-4c8d-9fe7-9c95f581e21d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:12.713282 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b755846-9750-4c8d-9fe7-9c95f581e21d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:12.714010 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b755846-9750-4c8d-9fe7-9c95f581e21d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:12.714475 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b755846-9750-4c8d-9fe7-9c95f581e21d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:12.714903 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5b755846-9750-4c8d-9fe7-9c95f581e21d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:12.885598 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-5b755846-9750-4c8d-9fe7-9c95f581e21d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:12.894258 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-5b755846-9750-4c8d-9fe7-9c95f581e21d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:12.896041 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-5b755846-9750-4c8d-9fe7-9c95f581e21d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:12.898089 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5b755846-9750-4c8d-9fe7-9c95f581e21d tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1732 microversion: 2.20 time: 0.197002 Oct 01 04:24:12.898700 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 388/741] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:24:12 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1732 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:24:13.175996 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-747d0129-e8f5-4516-8091-6929ad033d3e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:13.177133 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-747d0129-e8f5-4516-8091-6929ad033d3e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 87cd0cbd-547d-4e0e-a797-7971ce307b17] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:13.185527 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-747d0129-e8f5-4516-8091-6929ad033d3e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:13.186722 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-747d0129-e8f5-4516-8091-6929ad033d3e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:13.187427 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-747d0129-e8f5-4516-8091-6929ad033d3e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:13.188826 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-747d0129-e8f5-4516-8091-6929ad033d3e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:13.189442 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-747d0129-e8f5-4516-8091-6929ad033d3e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:13.189876 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-747d0129-e8f5-4516-8091-6929ad033d3e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:13.299884 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2be65248-12be-49f1-b71c-a23c59745dbd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:13.301158 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2be65248-12be-49f1-b71c-a23c59745dbd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:13.308857 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2be65248-12be-49f1-b71c-a23c59745dbd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:13.309703 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2be65248-12be-49f1-b71c-a23c59745dbd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:13.310346 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2be65248-12be-49f1-b71c-a23c59745dbd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:13.311272 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2be65248-12be-49f1-b71c-a23c59745dbd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:13.312076 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2be65248-12be-49f1-b71c-a23c59745dbd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:13.312705 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2be65248-12be-49f1-b71c-a23c59745dbd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:13.377178 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-747d0129-e8f5-4516-8091-6929ad033d3e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:13.387087 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-747d0129-e8f5-4516-8091-6929ad033d3e tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17" status: 200 len: 1267 microversion: 2.1 time: 0.217048 Oct 01 04:24:13.388020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 354/742] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:13 2022] GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17 => generated 1267 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:13.399230 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2be65248-12be-49f1-b71c-a23c59745dbd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:13.408186 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2be65248-12be-49f1-b71c-a23c59745dbd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b" status: 200 len: 1606 microversion: 2.1 time: 0.112379 Oct 01 04:24:13.421669 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 389/743] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:13 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b => generated 1606 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:24:13.923200 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3d9d8190-926e-485f-b7f3-179e4ee9b925 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:13.923980 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3d9d8190-926e-485f-b7f3-179e4ee9b925 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:13.932983 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d9d8190-926e-485f-b7f3-179e4ee9b925 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:13.933866 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d9d8190-926e-485f-b7f3-179e4ee9b925 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:13.934383 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d9d8190-926e-485f-b7f3-179e4ee9b925 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:13.935180 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d9d8190-926e-485f-b7f3-179e4ee9b925 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:13.935714 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d9d8190-926e-485f-b7f3-179e4ee9b925 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:13.936160 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3d9d8190-926e-485f-b7f3-179e4ee9b925 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:14.088344 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-3d9d8190-926e-485f-b7f3-179e4ee9b925 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:14.096504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-3d9d8190-926e-485f-b7f3-179e4ee9b925 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:14.098003 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-3d9d8190-926e-485f-b7f3-179e4ee9b925 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:14.099174 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3d9d8190-926e-485f-b7f3-179e4ee9b925 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1732 microversion: 2.20 time: 0.179872 Oct 01 04:24:14.099742 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 355/744] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:24:13 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1732 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:24:14.413452 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ec720724-a726-4e2e-94ae-a6a3f1465209 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:14.414937 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ec720724-a726-4e2e-94ae-a6a3f1465209 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 87cd0cbd-547d-4e0e-a797-7971ce307b17] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:14.423284 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec720724-a726-4e2e-94ae-a6a3f1465209 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:14.424060 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec720724-a726-4e2e-94ae-a6a3f1465209 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:14.424707 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec720724-a726-4e2e-94ae-a6a3f1465209 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:14.426709 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec720724-a726-4e2e-94ae-a6a3f1465209 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:14.426709 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec720724-a726-4e2e-94ae-a6a3f1465209 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:14.426709 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ec720724-a726-4e2e-94ae-a6a3f1465209 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:14.432491 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1728e033-f3df-46b1-897c-07e6f0e22097 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:14.433150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1728e033-f3df-46b1-897c-07e6f0e22097 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:14.439479 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1728e033-f3df-46b1-897c-07e6f0e22097 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:14.439970 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1728e033-f3df-46b1-897c-07e6f0e22097 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:14.440492 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1728e033-f3df-46b1-897c-07e6f0e22097 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:14.441491 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1728e033-f3df-46b1-897c-07e6f0e22097 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:14.442116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1728e033-f3df-46b1-897c-07e6f0e22097 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:14.442710 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1728e033-f3df-46b1-897c-07e6f0e22097 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:14.558730 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-1728e033-f3df-46b1-897c-07e6f0e22097 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:14.570024 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1728e033-f3df-46b1-897c-07e6f0e22097 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b" status: 200 len: 1606 microversion: 2.1 time: 0.141915 Oct 01 04:24:14.571295 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 356/745] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:14 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b => generated 1606 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:14.600509 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ec720724-a726-4e2e-94ae-a6a3f1465209 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:14.609375 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ec720724-a726-4e2e-94ae-a6a3f1465209 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17" status: 200 len: 1267 microversion: 2.1 time: 0.200555 Oct 01 04:24:14.609982 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 390/746] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:14 2022] GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17 => generated 1267 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:15.130492 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b8347d74-57f9-4221-bf0b-4abd8fee5e4f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:15.131783 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b8347d74-57f9-4221-bf0b-4abd8fee5e4f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:15.144562 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8347d74-57f9-4221-bf0b-4abd8fee5e4f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:15.145241 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8347d74-57f9-4221-bf0b-4abd8fee5e4f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:15.150742 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8347d74-57f9-4221-bf0b-4abd8fee5e4f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:15.151627 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8347d74-57f9-4221-bf0b-4abd8fee5e4f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:15.152167 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8347d74-57f9-4221-bf0b-4abd8fee5e4f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:15.152666 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8347d74-57f9-4221-bf0b-4abd8fee5e4f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:15.375342 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-b8347d74-57f9-4221-bf0b-4abd8fee5e4f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:15.388347 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-b8347d74-57f9-4221-bf0b-4abd8fee5e4f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:15.390280 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-b8347d74-57f9-4221-bf0b-4abd8fee5e4f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:15.391589 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b8347d74-57f9-4221-bf0b-4abd8fee5e4f tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1732 microversion: 2.20 time: 0.267954 Oct 01 04:24:15.392443 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 357/747] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:24:15 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1732 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:24:15.594873 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-179cadc0-66a4-4614-859d-73c1ed6482e2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:15.595564 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-179cadc0-66a4-4614-859d-73c1ed6482e2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:15.603170 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-179cadc0-66a4-4614-859d-73c1ed6482e2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:15.603998 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-179cadc0-66a4-4614-859d-73c1ed6482e2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:15.604641 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-179cadc0-66a4-4614-859d-73c1ed6482e2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:15.605592 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-179cadc0-66a4-4614-859d-73c1ed6482e2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:15.606250 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-179cadc0-66a4-4614-859d-73c1ed6482e2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:15.606841 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-179cadc0-66a4-4614-859d-73c1ed6482e2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:15.635902 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-47bdebb2-7b90-491d-8aa7-fce6bfc19916 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:15.636512 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-47bdebb2-7b90-491d-8aa7-fce6bfc19916 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 87cd0cbd-547d-4e0e-a797-7971ce307b17] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:15.649127 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47bdebb2-7b90-491d-8aa7-fce6bfc19916 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:15.650607 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47bdebb2-7b90-491d-8aa7-fce6bfc19916 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:15.651056 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47bdebb2-7b90-491d-8aa7-fce6bfc19916 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:15.651790 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47bdebb2-7b90-491d-8aa7-fce6bfc19916 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:15.652256 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47bdebb2-7b90-491d-8aa7-fce6bfc19916 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:15.652686 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-47bdebb2-7b90-491d-8aa7-fce6bfc19916 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:15.774109 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-179cadc0-66a4-4614-859d-73c1ed6482e2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:15.785744 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-179cadc0-66a4-4614-859d-73c1ed6482e2 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b" status: 200 len: 1606 microversion: 2.1 time: 0.195085 Oct 01 04:24:15.786536 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 391/748] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:15 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b => generated 1606 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:15.839498 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-47bdebb2-7b90-491d-8aa7-fce6bfc19916 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:15.850732 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-47bdebb2-7b90-491d-8aa7-fce6bfc19916 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17" status: 200 len: 1267 microversion: 2.1 time: 0.219038 Oct 01 04:24:15.851154 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 358/749] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:15 2022] GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17 => generated 1267 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:24:16.428604 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-88796e88-933b-418e-ba97-547921acf606 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:16.430048 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-88796e88-933b-418e-ba97-547921acf606 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:16.438918 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88796e88-933b-418e-ba97-547921acf606 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:16.439415 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88796e88-933b-418e-ba97-547921acf606 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:16.439849 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88796e88-933b-418e-ba97-547921acf606 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:16.440554 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88796e88-933b-418e-ba97-547921acf606 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:16.441037 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88796e88-933b-418e-ba97-547921acf606 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:16.441461 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-88796e88-933b-418e-ba97-547921acf606 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:16.626029 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-88796e88-933b-418e-ba97-547921acf606 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:16.634575 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-88796e88-933b-418e-ba97-547921acf606 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:16.636310 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-88796e88-933b-418e-ba97-547921acf606 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:16.637946 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-88796e88-933b-418e-ba97-547921acf606 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1732 microversion: 2.20 time: 0.218961 Oct 01 04:24:16.644002 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 392/750] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:24:16 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1732 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:24:16.810387 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-56c36d65-b898-4253-b1c6-0246b886dc1f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:16.811163 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-56c36d65-b898-4253-b1c6-0246b886dc1f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:16.818323 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56c36d65-b898-4253-b1c6-0246b886dc1f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:16.819187 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56c36d65-b898-4253-b1c6-0246b886dc1f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:16.819779 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56c36d65-b898-4253-b1c6-0246b886dc1f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:16.820491 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56c36d65-b898-4253-b1c6-0246b886dc1f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:16.821009 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56c36d65-b898-4253-b1c6-0246b886dc1f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:16.821442 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-56c36d65-b898-4253-b1c6-0246b886dc1f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:16.872918 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-770264f7-9143-40ec-96b8-5de0c09e63f3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:16.873563 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-770264f7-9143-40ec-96b8-5de0c09e63f3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 87cd0cbd-547d-4e0e-a797-7971ce307b17] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:16.882367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-770264f7-9143-40ec-96b8-5de0c09e63f3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:16.883417 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-770264f7-9143-40ec-96b8-5de0c09e63f3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:16.884028 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-770264f7-9143-40ec-96b8-5de0c09e63f3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:16.884744 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-770264f7-9143-40ec-96b8-5de0c09e63f3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:16.885281 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-770264f7-9143-40ec-96b8-5de0c09e63f3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:16.885709 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-770264f7-9143-40ec-96b8-5de0c09e63f3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:16.898151 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-56c36d65-b898-4253-b1c6-0246b886dc1f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:16.906432 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-56c36d65-b898-4253-b1c6-0246b886dc1f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b" status: 200 len: 1606 microversion: 2.1 time: 0.099925 Oct 01 04:24:16.921538 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 359/751] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:16 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b => generated 1606 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:17.040329 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-770264f7-9143-40ec-96b8-5de0c09e63f3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:17.048778 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-770264f7-9143-40ec-96b8-5de0c09e63f3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17" status: 200 len: 1267 microversion: 2.1 time: 0.179693 Oct 01 04:24:17.049548 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 393/752] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:16 2022] GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:24:17.665376 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-012c7ce1-cc5a-4e33-b896-cb821d401e15 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:17.666370 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-012c7ce1-cc5a-4e33-b896-cb821d401e15 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:17.675256 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-012c7ce1-cc5a-4e33-b896-cb821d401e15 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:17.675768 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-012c7ce1-cc5a-4e33-b896-cb821d401e15 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:17.676397 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-012c7ce1-cc5a-4e33-b896-cb821d401e15 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:17.677201 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-012c7ce1-cc5a-4e33-b896-cb821d401e15 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:17.677885 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-012c7ce1-cc5a-4e33-b896-cb821d401e15 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:17.678879 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-012c7ce1-cc5a-4e33-b896-cb821d401e15 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:17.822448 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-012c7ce1-cc5a-4e33-b896-cb821d401e15 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:17.832828 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-012c7ce1-cc5a-4e33-b896-cb821d401e15 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:17.834450 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-012c7ce1-cc5a-4e33-b896-cb821d401e15 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:17.835663 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-012c7ce1-cc5a-4e33-b896-cb821d401e15 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1732 microversion: 2.20 time: 0.174812 Oct 01 04:24:17.836400 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 360/753] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:24:17 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 01 04:24:17.932649 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-abec490b-d0aa-4127-8523-fbf739b7e31f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:17.933182 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-abec490b-d0aa-4127-8523-fbf739b7e31f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:17.945539 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abec490b-d0aa-4127-8523-fbf739b7e31f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:17.946097 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abec490b-d0aa-4127-8523-fbf739b7e31f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:17.947914 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abec490b-d0aa-4127-8523-fbf739b7e31f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:17.949307 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abec490b-d0aa-4127-8523-fbf739b7e31f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:17.949779 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abec490b-d0aa-4127-8523-fbf739b7e31f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:17.950492 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abec490b-d0aa-4127-8523-fbf739b7e31f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:18.011671 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abec490b-d0aa-4127-8523-fbf739b7e31f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:18.012316 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abec490b-d0aa-4127-8523-fbf739b7e31f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:18.012859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-abec490b-d0aa-4127-8523-fbf739b7e31f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:18.013431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-abec490b-d0aa-4127-8523-fbf739b7e31f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lazy-loading 'fault' on Instance uuid fe5ffc66-fce0-4d07-9190-6b4634a9047b {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:24:18.066589 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-abec490b-d0aa-4127-8523-fbf739b7e31f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3caf1cc366434d418c474d7a1879faa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16cd7bcb315d4dc58f73a9918adb57e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:18.075244 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4458e620-0961-405b-8310-9792da51237d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:18.077805 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-abec490b-d0aa-4127-8523-fbf739b7e31f tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b" status: 200 len: 1328 microversion: 2.1 time: 0.149748 Oct 01 04:24:18.092954 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 394/754] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:17 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b => generated 1328 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:18.097726 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4458e620-0961-405b-8310-9792da51237d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 87cd0cbd-547d-4e0e-a797-7971ce307b17] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:18.107107 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4458e620-0961-405b-8310-9792da51237d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:18.107878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4458e620-0961-405b-8310-9792da51237d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:18.108637 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4458e620-0961-405b-8310-9792da51237d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:18.110155 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4458e620-0961-405b-8310-9792da51237d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:18.111593 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4458e620-0961-405b-8310-9792da51237d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:18.112244 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4458e620-0961-405b-8310-9792da51237d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:18.269623 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-4458e620-0961-405b-8310-9792da51237d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:18.279892 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4458e620-0961-405b-8310-9792da51237d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17" status: 200 len: 1267 microversion: 2.1 time: 0.211194 Oct 01 04:24:18.290484 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 361/755] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:18 2022] GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17 => generated 1267 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:18.868301 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e0344de3-dcf4-4178-88bc-c1858c2fd532 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:18.870376 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e0344de3-dcf4-4178-88bc-c1858c2fd532 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:18.883983 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0344de3-dcf4-4178-88bc-c1858c2fd532 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:18.884793 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0344de3-dcf4-4178-88bc-c1858c2fd532 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:18.885257 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0344de3-dcf4-4178-88bc-c1858c2fd532 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:18.886490 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0344de3-dcf4-4178-88bc-c1858c2fd532 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:18.887238 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0344de3-dcf4-4178-88bc-c1858c2fd532 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:18.888012 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e0344de3-dcf4-4178-88bc-c1858c2fd532 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:19.106772 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-db9d3a99-9e63-42a2-972c-0b9bef6ba060 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:19.108223 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-db9d3a99-9e63-42a2-972c-0b9bef6ba060 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:19.123788 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db9d3a99-9e63-42a2-972c-0b9bef6ba060 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:19.124978 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db9d3a99-9e63-42a2-972c-0b9bef6ba060 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:19.126852 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db9d3a99-9e63-42a2-972c-0b9bef6ba060 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:19.129551 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db9d3a99-9e63-42a2-972c-0b9bef6ba060 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:19.130264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db9d3a99-9e63-42a2-972c-0b9bef6ba060 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:19.133721 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-db9d3a99-9e63-42a2-972c-0b9bef6ba060 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:19.156724 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-db9d3a99-9e63-42a2-972c-0b9bef6ba060 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] HTTP exception thrown: Instance fe5ffc66-fce0-4d07-9190-6b4634a9047b could not be found. Oct 01 04:24:19.159014 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-db9d3a99-9e63-42a2-972c-0b9bef6ba060 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Request method failure captured: Oct 01 04:24:19.159014 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b HTTP/1.1 Oct 01 04:24:19.159014 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept: application/json Oct 01 04:24:19.159014 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept-Encoding: identity Oct 01 04:24:19.159014 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Connection: close Oct 01 04:24:19.159014 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Length: 0 Oct 01 04:24:19.159014 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Type: application/json Oct 01 04:24:19.159014 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Host: 10.222.0.26 Oct 01 04:24:19.159014 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 01 04:24:19.159014 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 01 04:24:19.159014 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjN793DKBHUhC-8QdnYoBZGQnpA7Z6XZ0cXz6I00yXSRLWMK4sPzrqT-uvoxjgq718m7wHYzeTmJlBa5AQY06IF7N2cegWa6k9oAHMUQM7aCreRAFUUWl6tW7NhnlypA1LGn1wmWuHWdWqqQVRPKodN95UaXd0S8hRw2bWT-5aqn6kOOw Oct 01 04:24:19.159014 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Id: None Oct 01 04:24:19.159014 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Name: None Oct 01 04:24:19.159014 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 01 04:24:19.159014 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 01 04:24:19.159014 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 01 04:24:19.159014 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 01 04:24:19.159014 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Id: 16cd7bcb315d4dc58f73a9918adb57e2 Oct 01 04:24:19.159014 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Name: tempest-AttachVolumeTestJSON-20448997 Oct 01 04:24:19.159014 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Role: reader,member Oct 01 04:24:19.159014 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Roles: reader,member Oct 01 04:24:19.160436 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16cd7bcb315d4dc58f73a9918adb57e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16cd7bcb315d4dc58f73a9918adb57e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16cd7bcb315d4dc58f73a9918adb57e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16cd7bcb315d4dc58f73a9918adb57e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:24:19.160436 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant: tempest-AttachVolumeTestJSON-20448997 Oct 01 04:24:19.160436 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Id: 16cd7bcb315d4dc58f73a9918adb57e2 Oct 01 04:24:19.160436 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachVolumeTestJSON-20448997 Oct 01 04:24:19.160436 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User: tempest-AttachVolumeTestJSON-20448997-project Oct 01 04:24:19.160436 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 01 04:24:19.160436 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 01 04:24:19.160436 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Id: 3caf1cc366434d418c474d7a1879faa7 Oct 01 04:24:19.160436 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Name: tempest-AttachVolumeTestJSON-20448997-project Oct 01 04:24:19.160436 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: method: > Oct 01 04:24:19.160436 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: exception: Instance fe5ffc66-fce0-4d07-9190-6b4634a9047b could not be found. Oct 01 04:24:19.160436 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: action_args: {'id': 'fe5ffc66-fce0-4d07-9190-6b4634a9047b'} Oct 01 04:24:19.161255 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:24:19.161255 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:19.161255 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:24:19.161255 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:24:19.161255 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:24:19.161255 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:24:19.161255 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:24:19.161255 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:24:19.161255 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:24:19.161255 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:24:19.161255 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe5ffc66-fce0-4d07-9190-6b4634a9047b could not be found. Oct 01 04:24:19.161255 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:24:19.161255 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:24:19.161255 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:24:19.161255 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:19.161255 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:24:19.161255 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:24:19.161255 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:24:19.161255 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:24:19.161255 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:24:19.163246 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:24:19.163246 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:24:19.163246 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:24:19.163246 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:24:19.163246 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:24:19.163246 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:24:19.163246 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:24:19.163246 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe5ffc66-fce0-4d07-9190-6b4634a9047b could not be found. Oct 01 04:24:19.163246 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:24:19.163246 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:24:19.163246 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:24:19.163246 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:19.163246 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:24:19.163246 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:24:19.163246 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:24:19.163246 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:24:19.163246 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe5ffc66-fce0-4d07-9190-6b4634a9047b could not be found. Oct 01 04:24:19.163246 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:24:19.166016 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-db9d3a99-9e63-42a2-972c-0b9bef6ba060 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Returning 404 to user: Instance fe5ffc66-fce0-4d07-9190-6b4634a9047b could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:24:19.167205 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-db9d3a99-9e63-42a2-972c-0b9bef6ba060 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b" status: 404 len: 111 microversion: 2.1 time: 0.064913 Oct 01 04:24:19.172167 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 362/756] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:19 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:24:19.179415 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2ccbe73d-c86a-420c-82bf-238355a70923 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '.version_select at 0x7fdfbe6a94c0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:19.185418 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e0344de3-dcf4-4178-88bc-c1858c2fd532 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:19.202077 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2ccbe73d-c86a-420c-82bf-238355a70923 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1141803734" status: 202 len: 0 microversion: 2.1 time: 0.028307 Oct 01 04:24:19.202281 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e0344de3-dcf4-4178-88bc-c1858c2fd532 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:19.202720 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 363/757] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 1 04:24:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1141803734 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 04:24:19.205668 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e0344de3-dcf4-4178-88bc-c1858c2fd532 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:19.211708 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e0344de3-dcf4-4178-88bc-c1858c2fd532 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1732 microversion: 2.20 time: 0.346105 Oct 01 04:24:19.212753 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 395/758] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:24:18 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1732 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:24:19.317005 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-94c5864b-b651-4d56-b24b-906217b47ac7 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:19.317849 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-94c5864b-b651-4d56-b24b-906217b47ac7 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 87cd0cbd-547d-4e0e-a797-7971ce307b17] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:19.328395 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94c5864b-b651-4d56-b24b-906217b47ac7 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:19.329056 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94c5864b-b651-4d56-b24b-906217b47ac7 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:19.329833 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94c5864b-b651-4d56-b24b-906217b47ac7 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:19.330769 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94c5864b-b651-4d56-b24b-906217b47ac7 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:19.331399 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94c5864b-b651-4d56-b24b-906217b47ac7 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:19.332052 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-94c5864b-b651-4d56-b24b-906217b47ac7 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:19.619684 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-94c5864b-b651-4d56-b24b-906217b47ac7 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:19.634638 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-94c5864b-b651-4d56-b24b-906217b47ac7 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17" status: 200 len: 1455 microversion: 2.1 time: 0.325443 Oct 01 04:24:19.639312 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 364/759] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:19 2022] GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17 => generated 1455 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:19.661891 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5a2bee7e-e48f-4b32-a84c-841538f64b77 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:19.663403 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5a2bee7e-e48f-4b32-a84c-841538f64b77 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 87cd0cbd-547d-4e0e-a797-7971ce307b17] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:19.671139 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a2bee7e-e48f-4b32-a84c-841538f64b77 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:19.671986 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a2bee7e-e48f-4b32-a84c-841538f64b77 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:19.673079 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a2bee7e-e48f-4b32-a84c-841538f64b77 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:19.673984 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a2bee7e-e48f-4b32-a84c-841538f64b77 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:19.674648 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a2bee7e-e48f-4b32-a84c-841538f64b77 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:19.675363 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5a2bee7e-e48f-4b32-a84c-841538f64b77 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:19.877304 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-5a2bee7e-e48f-4b32-a84c-841538f64b77 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:19.887837 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5a2bee7e-e48f-4b32-a84c-841538f64b77 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17" status: 200 len: 1455 microversion: 2.1 time: 0.230295 Oct 01 04:24:19.889416 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 396/760] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:19 2022] GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17 => generated 1455 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:20.241968 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-02f59205-e346-46c3-8c3c-af1f531aab2b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:20.243737 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-02f59205-e346-46c3-8c3c-af1f531aab2b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:20.258128 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02f59205-e346-46c3-8c3c-af1f531aab2b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:20.258767 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02f59205-e346-46c3-8c3c-af1f531aab2b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:20.260814 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02f59205-e346-46c3-8c3c-af1f531aab2b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:20.264280 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02f59205-e346-46c3-8c3c-af1f531aab2b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:20.265540 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02f59205-e346-46c3-8c3c-af1f531aab2b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:20.266774 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02f59205-e346-46c3-8c3c-af1f531aab2b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:20.651303 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-02f59205-e346-46c3-8c3c-af1f531aab2b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:20.661655 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-02f59205-e346-46c3-8c3c-af1f531aab2b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:20.663966 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-02f59205-e346-46c3-8c3c-af1f531aab2b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:20.665449 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-02f59205-e346-46c3-8c3c-af1f531aab2b tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1732 microversion: 2.20 time: 0.429451 Oct 01 04:24:20.666236 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 365/761] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:24:20 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1732 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:24:21.691421 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7249306c-14cb-4ce7-bab0-401ab5d8a40c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:21.692112 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7249306c-14cb-4ce7-bab0-401ab5d8a40c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:21.701990 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7249306c-14cb-4ce7-bab0-401ab5d8a40c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:21.705105 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7249306c-14cb-4ce7-bab0-401ab5d8a40c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:21.705764 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7249306c-14cb-4ce7-bab0-401ab5d8a40c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:21.706663 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7249306c-14cb-4ce7-bab0-401ab5d8a40c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:21.707310 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7249306c-14cb-4ce7-bab0-401ab5d8a40c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:21.710154 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7249306c-14cb-4ce7-bab0-401ab5d8a40c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:21.881428 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-828a1401-9420-4921-8378-223de37070ad req-b6cfd9d7-ed15-4822-8de7-4496b90378e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b21e7357-43a2-4dc9-b0f6-26b14b68c464", "name": "network-vif-plugged", "status": "completed", "tag": "735577aa-5ec2-48d4-8f41-38cb8f95250a"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:24:21.901179 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-828a1401-9420-4921-8378-223de37070ad req-b6cfd9d7-ed15-4822-8de7-4496b90378e8 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:21.906311 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-828a1401-9420-4921-8378-223de37070ad req-b6cfd9d7-ed15-4822-8de7-4496b90378e8 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:21.907034 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-828a1401-9420-4921-8378-223de37070ad req-b6cfd9d7-ed15-4822-8de7-4496b90378e8 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:21.925721 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7249306c-14cb-4ce7-bab0-401ab5d8a40c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:21.932486 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-828a1401-9420-4921-8378-223de37070ad req-b6cfd9d7-ed15-4822-8de7-4496b90378e8 service nova] Creating event network-vif-plugged:735577aa-5ec2-48d4-8f41-38cb8f95250a for instance b21e7357-43a2-4dc9-b0f6-26b14b68c464 on hv-cinder-86004 Oct 01 04:24:21.944363 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7249306c-14cb-4ce7-bab0-401ab5d8a40c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:21.946613 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7249306c-14cb-4ce7-bab0-401ab5d8a40c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:21.948711 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-828a1401-9420-4921-8378-223de37070ad req-b6cfd9d7-ed15-4822-8de7-4496b90378e8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071594 Oct 01 04:24:21.950064 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 366/762] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:24:21.954749 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7249306c-14cb-4ce7-bab0-401ab5d8a40c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1732 microversion: 2.20 time: 0.266298 Oct 01 04:24:21.956138 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 397/763] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:24:21 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1732 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:24:22.543436 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3183a7e1-c0bb-467e-9991-fb12aafae944 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:22.544149 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3183a7e1-c0bb-467e-9991-fb12aafae944 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:22.557455 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3183a7e1-c0bb-467e-9991-fb12aafae944 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:22.557964 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3183a7e1-c0bb-467e-9991-fb12aafae944 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:22.558411 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3183a7e1-c0bb-467e-9991-fb12aafae944 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:22.559135 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3183a7e1-c0bb-467e-9991-fb12aafae944 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:22.560107 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3183a7e1-c0bb-467e-9991-fb12aafae944 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:22.560107 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3183a7e1-c0bb-467e-9991-fb12aafae944 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:22.600307 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-3183a7e1-c0bb-467e-9991-fb12aafae944 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] HTTP exception thrown: Instance fe5ffc66-fce0-4d07-9190-6b4634a9047b could not be found. Oct 01 04:24:22.602959 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3183a7e1-c0bb-467e-9991-fb12aafae944 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Request method failure captured: Oct 01 04:24:22.602959 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b HTTP/1.1 Oct 01 04:24:22.602959 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept: application/json Oct 01 04:24:22.602959 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept-Encoding: identity Oct 01 04:24:22.602959 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Connection: close Oct 01 04:24:22.602959 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Length: 0 Oct 01 04:24:22.602959 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Type: application/json Oct 01 04:24:22.602959 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Host: 10.222.0.26 Oct 01 04:24:22.602959 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 01 04:24:22.602959 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 01 04:24:22.602959 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjN793DKBHUhC-8QdnYoBZGQnpA7Z6XZ0cXz6I00yXSRLWMK4sPzrqT-uvoxjgq718m7wHYzeTmJlBa5AQY06IF7N2cegWa6k9oAHMUQM7aCreRAFUUWl6tW7NhnlypA1LGn1wmWuHWdWqqQVRPKodN95UaXd0S8hRw2bWT-5aqn6kOOw Oct 01 04:24:22.602959 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Id: None Oct 01 04:24:22.602959 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Name: None Oct 01 04:24:22.602959 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 01 04:24:22.602959 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 01 04:24:22.602959 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 01 04:24:22.602959 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 01 04:24:22.602959 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Id: 16cd7bcb315d4dc58f73a9918adb57e2 Oct 01 04:24:22.602959 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Name: tempest-AttachVolumeTestJSON-20448997 Oct 01 04:24:22.602959 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Role: reader,member Oct 01 04:24:22.602959 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Roles: reader,member Oct 01 04:24:22.604332 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16cd7bcb315d4dc58f73a9918adb57e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16cd7bcb315d4dc58f73a9918adb57e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16cd7bcb315d4dc58f73a9918adb57e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16cd7bcb315d4dc58f73a9918adb57e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:24:22.604332 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant: tempest-AttachVolumeTestJSON-20448997 Oct 01 04:24:22.604332 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Id: 16cd7bcb315d4dc58f73a9918adb57e2 Oct 01 04:24:22.604332 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachVolumeTestJSON-20448997 Oct 01 04:24:22.604332 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User: tempest-AttachVolumeTestJSON-20448997-project Oct 01 04:24:22.604332 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 01 04:24:22.604332 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 01 04:24:22.604332 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Id: 3caf1cc366434d418c474d7a1879faa7 Oct 01 04:24:22.604332 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Name: tempest-AttachVolumeTestJSON-20448997-project Oct 01 04:24:22.604332 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: method: > Oct 01 04:24:22.604332 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: exception: Instance fe5ffc66-fce0-4d07-9190-6b4634a9047b could not be found. Oct 01 04:24:22.604332 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: action_args: {'id': 'fe5ffc66-fce0-4d07-9190-6b4634a9047b'} Oct 01 04:24:22.605116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:24:22.605116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:22.605116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:24:22.605116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:24:22.605116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:24:22.605116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:24:22.605116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:24:22.605116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:24:22.605116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:24:22.605116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:24:22.605116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe5ffc66-fce0-4d07-9190-6b4634a9047b could not be found. Oct 01 04:24:22.605116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:24:22.605116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:24:22.605116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:24:22.605116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:22.605116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:24:22.605116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:24:22.605116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:24:22.605116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:24:22.605116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:24:22.606346 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:24:22.606346 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 04:24:22.606346 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 04:24:22.606346 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 04:24:22.606346 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 04:24:22.606346 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:24:22.606346 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:24:22.606346 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:24:22.606346 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:24:22.606346 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe5ffc66-fce0-4d07-9190-6b4634a9047b could not be found. Oct 01 04:24:22.606346 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:24:22.606346 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:24:22.606346 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:24:22.606346 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:22.606346 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:24:22.606346 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:24:22.606346 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:24:22.606346 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:24:22.606346 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe5ffc66-fce0-4d07-9190-6b4634a9047b could not be found. Oct 01 04:24:22.606346 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:24:22.607551 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3183a7e1-c0bb-467e-9991-fb12aafae944 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Returning 404 to user: Instance fe5ffc66-fce0-4d07-9190-6b4634a9047b could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:24:22.608835 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3183a7e1-c0bb-467e-9991-fb12aafae944 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b" status: 404 len: 111 microversion: 2.1 time: 0.069511 Oct 01 04:24:22.611139 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 367/764] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 1 04:24:22 2022] DELETE /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:24:22.619560 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-25a96dd9-f20c-4f3d-9114-abe53b55ab13 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:22.620196 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-25a96dd9-f20c-4f3d-9114-abe53b55ab13 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: fe5ffc66-fce0-4d07-9190-6b4634a9047b] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:22.627035 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25a96dd9-f20c-4f3d-9114-abe53b55ab13 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:22.627533 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25a96dd9-f20c-4f3d-9114-abe53b55ab13 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:22.627974 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25a96dd9-f20c-4f3d-9114-abe53b55ab13 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:22.628683 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25a96dd9-f20c-4f3d-9114-abe53b55ab13 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:22.629177 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25a96dd9-f20c-4f3d-9114-abe53b55ab13 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:22.640148 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25a96dd9-f20c-4f3d-9114-abe53b55ab13 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:22.660896 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-d83a3d63-cf37-49b9-8404-afbaa21a44f0 req-f09b01ea-c534-453f-b43e-8797b852e14b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87cd0cbd-547d-4e0e-a797-7971ce307b17", "tag": "998978bd-7095-4f80-b84b-5589f1d6add2"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:24:22.672471 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d83a3d63-cf37-49b9-8404-afbaa21a44f0 req-f09b01ea-c534-453f-b43e-8797b852e14b service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:22.673439 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d83a3d63-cf37-49b9-8404-afbaa21a44f0 req-f09b01ea-c534-453f-b43e-8797b852e14b service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:22.674321 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-25a96dd9-f20c-4f3d-9114-abe53b55ab13 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] HTTP exception thrown: Instance fe5ffc66-fce0-4d07-9190-6b4634a9047b could not be found. Oct 01 04:24:22.674791 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-d83a3d63-cf37-49b9-8404-afbaa21a44f0 req-f09b01ea-c534-453f-b43e-8797b852e14b service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:22.681479 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-25a96dd9-f20c-4f3d-9114-abe53b55ab13 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Request method failure captured: Oct 01 04:24:22.681479 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b HTTP/1.1 Oct 01 04:24:22.681479 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:24:22.681479 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:24:22.681479 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:24:22.681479 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 0 Oct 01 04:24:22.681479 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:24:22.681479 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:24:22.681479 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:24:22.681479 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:24:22.681479 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN793DKBHUhC-8QdnYoBZGQnpA7Z6XZ0cXz6I00yXSRLWMK4sPzrqT-uvoxjgq718m7wHYzeTmJlBa5AQY06IF7N2cegWa6k9oAHMUQM7aCreRAFUUWl6tW7NhnlypA1LGn1wmWuHWdWqqQVRPKodN95UaXd0S8hRw2bWT-5aqn6kOOw Oct 01 04:24:22.681479 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:24:22.681479 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:24:22.681479 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:24:22.681479 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:24:22.681479 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:24:22.681479 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:24:22.681479 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: 16cd7bcb315d4dc58f73a9918adb57e2 Oct 01 04:24:22.681479 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeTestJSON-20448997 Oct 01 04:24:22.681479 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:24:22.681479 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:24:22.682859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16cd7bcb315d4dc58f73a9918adb57e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16cd7bcb315d4dc58f73a9918adb57e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16cd7bcb315d4dc58f73a9918adb57e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16cd7bcb315d4dc58f73a9918adb57e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:24:22.682859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeTestJSON-20448997 Oct 01 04:24:22.682859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 16cd7bcb315d4dc58f73a9918adb57e2 Oct 01 04:24:22.682859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeTestJSON-20448997 Oct 01 04:24:22.682859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-AttachVolumeTestJSON-20448997-project Oct 01 04:24:22.682859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:24:22.682859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:24:22.682859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: 3caf1cc366434d418c474d7a1879faa7 Oct 01 04:24:22.682859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeTestJSON-20448997-project Oct 01 04:24:22.682859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: > Oct 01 04:24:22.682859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Instance fe5ffc66-fce0-4d07-9190-6b4634a9047b could not be found. Oct 01 04:24:22.682859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'id': 'fe5ffc66-fce0-4d07-9190-6b4634a9047b'} Oct 01 04:24:22.683612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:24:22.683612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:22.683612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:24:22.683612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:24:22.683612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:24:22.683612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:24:22.683612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:24:22.683612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:24:22.683612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:24:22.683612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:24:22.683612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe5ffc66-fce0-4d07-9190-6b4634a9047b could not be found. Oct 01 04:24:22.683612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:24:22.683612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:24:22.683612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:24:22.683612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:22.683612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:24:22.683612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:24:22.683612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:24:22.683612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:24:22.683612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:24:22.684810 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:24:22.684810 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:24:22.684810 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:24:22.684810 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:24:22.684810 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:24:22.684810 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:24:22.684810 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:24:22.684810 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe5ffc66-fce0-4d07-9190-6b4634a9047b could not be found. Oct 01 04:24:22.684810 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:24:22.684810 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:24:22.684810 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:24:22.684810 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:22.684810 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:24:22.684810 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:24:22.684810 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:24:22.684810 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:24:22.684810 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe5ffc66-fce0-4d07-9190-6b4634a9047b could not be found. Oct 01 04:24:22.684810 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:24:22.685926 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-25a96dd9-f20c-4f3d-9114-abe53b55ab13 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Returning 404 to user: Instance fe5ffc66-fce0-4d07-9190-6b4634a9047b could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:24:22.685926 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-25a96dd9-f20c-4f3d-9114-abe53b55ab13 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b" status: 404 len: 111 microversion: 2.1 time: 0.070454 Oct 01 04:24:22.686503 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 398/765] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:22 2022] GET /compute/v2.1/servers/fe5ffc66-fce0-4d07-9190-6b4634a9047b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:24:22.696167 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-d83a3d63-cf37-49b9-8404-afbaa21a44f0 req-f09b01ea-c534-453f-b43e-8797b852e14b service nova] Creating event network-changed:998978bd-7095-4f80-b84b-5589f1d6add2 for instance 87cd0cbd-547d-4e0e-a797-7971ce307b17 on hv-cinder-86004 Oct 01 04:24:22.702467 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-d83a3d63-cf37-49b9-8404-afbaa21a44f0 req-f09b01ea-c534-453f-b43e-8797b852e14b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045094 Oct 01 04:24:22.703282 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 368/766] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:24:22.984347 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7bfa34b4-3bf8-47d5-80cb-061d79206d5c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:22.986284 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7bfa34b4-3bf8-47d5-80cb-061d79206d5c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:23.013396 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bfa34b4-3bf8-47d5-80cb-061d79206d5c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:23.014174 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bfa34b4-3bf8-47d5-80cb-061d79206d5c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:23.014959 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bfa34b4-3bf8-47d5-80cb-061d79206d5c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:23.016423 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bfa34b4-3bf8-47d5-80cb-061d79206d5c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:23.017170 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bfa34b4-3bf8-47d5-80cb-061d79206d5c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:23.019016 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7bfa34b4-3bf8-47d5-80cb-061d79206d5c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:23.401383 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7bfa34b4-3bf8-47d5-80cb-061d79206d5c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:23.411760 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7bfa34b4-3bf8-47d5-80cb-061d79206d5c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:23.418595 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7bfa34b4-3bf8-47d5-80cb-061d79206d5c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:23.421389 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7bfa34b4-3bf8-47d5-80cb-061d79206d5c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1732 microversion: 2.20 time: 0.442446 Oct 01 04:24:23.424294 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 399/767] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:24:22 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1732 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:24:23.890555 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d343fcd5-cfae-4afb-bf2c-16d4df505cd7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:23.891927 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d343fcd5-cfae-4afb-bf2c-16d4df505cd7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:23.903405 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d343fcd5-cfae-4afb-bf2c-16d4df505cd7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:23.904222 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d343fcd5-cfae-4afb-bf2c-16d4df505cd7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:23.904977 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d343fcd5-cfae-4afb-bf2c-16d4df505cd7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:23.905921 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d343fcd5-cfae-4afb-bf2c-16d4df505cd7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:23.906599 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d343fcd5-cfae-4afb-bf2c-16d4df505cd7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:23.907246 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d343fcd5-cfae-4afb-bf2c-16d4df505cd7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:23.925227 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-d343fcd5-cfae-4afb-bf2c-16d4df505cd7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] HTTP exception thrown: Instance c2643a3f-906d-4cb4-8b4f-f2a63557ab69 could not be found. Oct 01 04:24:23.927446 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d343fcd5-cfae-4afb-bf2c-16d4df505cd7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Request method failure captured: Oct 01 04:24:23.927446 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 HTTP/1.1 Oct 01 04:24:23.927446 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept: application/json Oct 01 04:24:23.927446 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept-Encoding: identity Oct 01 04:24:23.927446 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Connection: close Oct 01 04:24:23.927446 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Length: 0 Oct 01 04:24:23.927446 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Type: application/json Oct 01 04:24:23.927446 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Host: 10.222.0.26 Oct 01 04:24:23.927446 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 01 04:24:23.927446 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 01 04:24:23.927446 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjN793DKBHUhC-8QdnYoBZGQnpA7Z6XZ0cXz6I00yXSRLWMK4sPzrqT-uvoxjgq718m7wHYzeTmJlBa5AQY06IF7N2cegWa6k9oAHMUQM7aCreRAFUUWl6tW7NhnlypA1LGn1wmWuHWdWqqQVRPKodN95UaXd0S8hRw2bWT-5aqn6kOOw Oct 01 04:24:23.927446 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Id: None Oct 01 04:24:23.927446 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Name: None Oct 01 04:24:23.927446 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 01 04:24:23.927446 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 01 04:24:23.927446 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 01 04:24:23.927446 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 01 04:24:23.927446 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Id: 16cd7bcb315d4dc58f73a9918adb57e2 Oct 01 04:24:23.927446 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Name: tempest-AttachVolumeTestJSON-20448997 Oct 01 04:24:23.927446 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Role: reader,member Oct 01 04:24:23.927446 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Roles: reader,member Oct 01 04:24:23.928804 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16cd7bcb315d4dc58f73a9918adb57e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16cd7bcb315d4dc58f73a9918adb57e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16cd7bcb315d4dc58f73a9918adb57e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16cd7bcb315d4dc58f73a9918adb57e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:24:23.928804 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant: tempest-AttachVolumeTestJSON-20448997 Oct 01 04:24:23.928804 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Id: 16cd7bcb315d4dc58f73a9918adb57e2 Oct 01 04:24:23.928804 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachVolumeTestJSON-20448997 Oct 01 04:24:23.928804 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User: tempest-AttachVolumeTestJSON-20448997-project Oct 01 04:24:23.928804 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 01 04:24:23.928804 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 01 04:24:23.928804 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Id: 3caf1cc366434d418c474d7a1879faa7 Oct 01 04:24:23.928804 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Name: tempest-AttachVolumeTestJSON-20448997-project Oct 01 04:24:23.928804 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: method: > Oct 01 04:24:23.928804 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: exception: Instance c2643a3f-906d-4cb4-8b4f-f2a63557ab69 could not be found. Oct 01 04:24:23.928804 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: action_args: {'id': 'c2643a3f-906d-4cb4-8b4f-f2a63557ab69'} Oct 01 04:24:23.929562 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:24:23.929562 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:23.929562 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:24:23.929562 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:24:23.929562 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:24:23.929562 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:24:23.929562 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:24:23.929562 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:24:23.929562 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:24:23.929562 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:24:23.929562 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2643a3f-906d-4cb4-8b4f-f2a63557ab69 could not be found. Oct 01 04:24:23.929562 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:24:23.929562 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:24:23.929562 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:24:23.929562 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:23.929562 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:24:23.929562 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:24:23.929562 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:24:23.929562 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:24:23.929562 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:24:23.930741 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:24:23.930741 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 04:24:23.930741 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 04:24:23.930741 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 04:24:23.930741 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 04:24:23.930741 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:24:23.930741 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:24:23.930741 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:24:23.930741 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:24:23.930741 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2643a3f-906d-4cb4-8b4f-f2a63557ab69 could not be found. Oct 01 04:24:23.930741 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:24:23.930741 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:24:23.930741 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:24:23.930741 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:23.930741 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:24:23.930741 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:24:23.930741 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:24:23.930741 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:24:23.930741 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2643a3f-906d-4cb4-8b4f-f2a63557ab69 could not be found. Oct 01 04:24:23.930741 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:24:23.934540 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d343fcd5-cfae-4afb-bf2c-16d4df505cd7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Returning 404 to user: Instance c2643a3f-906d-4cb4-8b4f-f2a63557ab69 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:24:23.935819 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d343fcd5-cfae-4afb-bf2c-16d4df505cd7 tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 404 len: 111 microversion: 2.1 time: 0.049579 Oct 01 04:24:23.937027 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 369/768] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 1 04:24:23 2022] DELETE /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:24:23.945531 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3db7dea6-fb83-48da-bf93-4cd57bd3c4dd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:23.946157 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3db7dea6-fb83-48da-bf93-4cd57bd3c4dd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] [instance: c2643a3f-906d-4cb4-8b4f-f2a63557ab69] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:23.957463 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3db7dea6-fb83-48da-bf93-4cd57bd3c4dd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:23.957980 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3db7dea6-fb83-48da-bf93-4cd57bd3c4dd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:23.958434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3db7dea6-fb83-48da-bf93-4cd57bd3c4dd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:23.959730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3db7dea6-fb83-48da-bf93-4cd57bd3c4dd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:23.960196 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3db7dea6-fb83-48da-bf93-4cd57bd3c4dd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:23.960625 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3db7dea6-fb83-48da-bf93-4cd57bd3c4dd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:24.004166 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-3db7dea6-fb83-48da-bf93-4cd57bd3c4dd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] HTTP exception thrown: Instance c2643a3f-906d-4cb4-8b4f-f2a63557ab69 could not be found. Oct 01 04:24:24.007395 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3db7dea6-fb83-48da-bf93-4cd57bd3c4dd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Request method failure captured: Oct 01 04:24:24.007395 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 HTTP/1.1 Oct 01 04:24:24.007395 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:24:24.007395 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:24:24.007395 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:24:24.007395 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 0 Oct 01 04:24:24.007395 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:24:24.007395 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:24:24.007395 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:24:24.007395 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:24:24.007395 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN793DKBHUhC-8QdnYoBZGQnpA7Z6XZ0cXz6I00yXSRLWMK4sPzrqT-uvoxjgq718m7wHYzeTmJlBa5AQY06IF7N2cegWa6k9oAHMUQM7aCreRAFUUWl6tW7NhnlypA1LGn1wmWuHWdWqqQVRPKodN95UaXd0S8hRw2bWT-5aqn6kOOw Oct 01 04:24:24.007395 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:24:24.007395 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:24:24.007395 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:24:24.007395 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:24:24.007395 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:24:24.007395 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:24:24.007395 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: 16cd7bcb315d4dc58f73a9918adb57e2 Oct 01 04:24:24.007395 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeTestJSON-20448997 Oct 01 04:24:24.007395 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:24:24.007395 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:24:24.009054 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_16cd7bcb315d4dc58f73a9918adb57e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16cd7bcb315d4dc58f73a9918adb57e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/16cd7bcb315d4dc58f73a9918adb57e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/16cd7bcb315d4dc58f73a9918adb57e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:24:24.009054 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeTestJSON-20448997 Oct 01 04:24:24.009054 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 16cd7bcb315d4dc58f73a9918adb57e2 Oct 01 04:24:24.009054 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeTestJSON-20448997 Oct 01 04:24:24.009054 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-AttachVolumeTestJSON-20448997-project Oct 01 04:24:24.009054 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:24:24.009054 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:24:24.009054 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: 3caf1cc366434d418c474d7a1879faa7 Oct 01 04:24:24.009054 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeTestJSON-20448997-project Oct 01 04:24:24.009054 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: > Oct 01 04:24:24.009054 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Instance c2643a3f-906d-4cb4-8b4f-f2a63557ab69 could not be found. Oct 01 04:24:24.009054 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'id': 'c2643a3f-906d-4cb4-8b4f-f2a63557ab69'} Oct 01 04:24:24.009970 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:24:24.009970 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:24.009970 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:24:24.009970 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:24:24.009970 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:24:24.009970 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:24:24.009970 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:24:24.009970 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:24:24.009970 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:24:24.009970 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:24:24.009970 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2643a3f-906d-4cb4-8b4f-f2a63557ab69 could not be found. Oct 01 04:24:24.009970 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:24:24.009970 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:24:24.009970 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:24:24.009970 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:24.009970 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:24:24.009970 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:24:24.009970 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:24:24.009970 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:24:24.009970 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:24:24.011374 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:24:24.011374 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:24:24.011374 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:24:24.011374 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:24:24.011374 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:24:24.011374 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:24:24.011374 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:24:24.011374 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2643a3f-906d-4cb4-8b4f-f2a63557ab69 could not be found. Oct 01 04:24:24.011374 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:24:24.011374 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:24:24.011374 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:24:24.011374 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:24.011374 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:24:24.011374 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:24:24.011374 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:24:24.011374 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:24:24.011374 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2643a3f-906d-4cb4-8b4f-f2a63557ab69 could not be found. Oct 01 04:24:24.011374 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:24:24.015585 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3db7dea6-fb83-48da-bf93-4cd57bd3c4dd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] Returning 404 to user: Instance c2643a3f-906d-4cb4-8b4f-f2a63557ab69 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:24:24.016676 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3db7dea6-fb83-48da-bf93-4cd57bd3c4dd tempest-AttachVolumeTestJSON-20448997 tempest-AttachVolumeTestJSON-20448997-project] 10.222.0.26 "GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69" status: 404 len: 111 microversion: 2.1 time: 0.075756 Oct 01 04:24:24.019255 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 400/769] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:23 2022] GET /compute/v2.1/servers/c2643a3f-906d-4cb4-8b4f-f2a63557ab69 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:24:24.455736 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6cdc14c9-65f2-4fc4-8ab6-ac8ce9909715 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:24.456360 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6cdc14c9-65f2-4fc4-8ab6-ac8ce9909715 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:24.505887 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6cdc14c9-65f2-4fc4-8ab6-ac8ce9909715 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:24.506818 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6cdc14c9-65f2-4fc4-8ab6-ac8ce9909715 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:24.507452 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6cdc14c9-65f2-4fc4-8ab6-ac8ce9909715 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:24.509142 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6cdc14c9-65f2-4fc4-8ab6-ac8ce9909715 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:24.509953 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6cdc14c9-65f2-4fc4-8ab6-ac8ce9909715 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:24.510580 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6cdc14c9-65f2-4fc4-8ab6-ac8ce9909715 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:24.518563 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=100 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:24.922056 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-6cdc14c9-65f2-4fc4-8ab6-ac8ce9909715 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:24.939009 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-6cdc14c9-65f2-4fc4-8ab6-ac8ce9909715 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:24.940871 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-6cdc14c9-65f2-4fc4-8ab6-ac8ce9909715 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:24.942349 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6cdc14c9-65f2-4fc4-8ab6-ac8ce9909715 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1732 microversion: 2.20 time: 0.490534 Oct 01 04:24:24.943932 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 370/770] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:24:24 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1732 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:24:25.973250 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f8b9d528-4457-4069-96e5-fd1f11ce2f36 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:25.975712 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f8b9d528-4457-4069-96e5-fd1f11ce2f36 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:25.978617 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:25.994147 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8b9d528-4457-4069-96e5-fd1f11ce2f36 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:26.000599 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8b9d528-4457-4069-96e5-fd1f11ce2f36 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:26.001372 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8b9d528-4457-4069-96e5-fd1f11ce2f36 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:26.002384 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8b9d528-4457-4069-96e5-fd1f11ce2f36 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:26.003026 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8b9d528-4457-4069-96e5-fd1f11ce2f36 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:26.003630 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8b9d528-4457-4069-96e5-fd1f11ce2f36 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:26.275129 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f8b9d528-4457-4069-96e5-fd1f11ce2f36 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:26.295493 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f8b9d528-4457-4069-96e5-fd1f11ce2f36 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:26.297270 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f8b9d528-4457-4069-96e5-fd1f11ce2f36 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:26.302154 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f8b9d528-4457-4069-96e5-fd1f11ce2f36 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1719 microversion: 2.20 time: 0.335054 Oct 01 04:24:26.314962 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 401/771] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:24:25 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1719 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:24:29.307848 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-44f308c0-76cf-48d4-a4a2-a13abbac4d35 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Action: 'create', calling method: .version_select at 0x7fdfbe736430>, body: {"keypair": {"name": "tempest-TestShelveInstance-169677656", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQQ5k3NtbFg6TQAgbyJuh5LHgatyszE5O9MzAEUosDXTg+YEIX8z4yVkvKa1OjW4BVQ1kwZnsqhukLEZjq0X/WPi44/7PIZQWVcnbkcuqClJ2tTWQlIuUt1vZryeOxZKg=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:24:29.344843 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-44f308c0-76cf-48d4-a4a2-a13abbac4d35 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Getting quotas for project 1eda12202e6f439b96a87a81d7531503. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:24:29.352283 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-44f308c0-76cf-48d4-a4a2-a13abbac4d35 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Getting quotas for user 944a3ab108184d5ab8784e21805f9873 and project 1eda12202e6f439b96a87a81d7531503. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:24:29.405951 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-44f308c0-76cf-48d4-a4a2-a13abbac4d35 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.318836 Oct 01 04:24:29.406666 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 371/772] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 1 04:24:29 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:24:31.094994 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-76b4908a-4333-4a98-8c2d-f86c32b1149a tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] Action: 'create', calling method: .version_select at 0x7fdfc218e310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1435242230"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:24:31.445780 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-76b4908a-4333-4a98-8c2d-f86c32b1149a tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.478468 Oct 01 04:24:31.447369 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 402/773] 10.222.0.26 () {60 vars in 1155 bytes} [Sat Oct 1 04:24:30 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 481 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 01 04:24:31.462303 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-599f572b-f85c-46f0-9af3-c490cdde570f tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] Calling method '.version_select at 0x7fdfbe6b9310>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:31.535664 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-599f572b-f85c-46f0-9af3-c490cdde570f tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/ca9a5e47-1b76-48e0-b0ab-39d309b66597" status: 200 len: 345 microversion: 2.1 time: 0.079090 Oct 01 04:24:31.536628 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 372/774] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 1 04:24:31 2022] GET /compute/v2.1/os-volumes/ca9a5e47-1b76-48e0-b0ab-39d309b66597 => generated 345 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:24:32.550581 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-87d4e249-8722-4499-ba0c-c10ce34ad9de tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] Calling method '.version_select at 0x7fdfbea3c4c0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:32.605868 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-87d4e249-8722-4499-ba0c-c10ce34ad9de tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/ca9a5e47-1b76-48e0-b0ab-39d309b66597" status: 200 len: 346 microversion: 2.1 time: 0.059548 Oct 01 04:24:32.606433 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 403/775] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 1 04:24:32 2022] GET /compute/v2.1/os-volumes/ca9a5e47-1b76-48e0-b0ab-39d309b66597 => generated 346 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:24:32.620240 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-587f999f-e36f-46b7-8199-47e0803c1984 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] Action: 'create', calling method: .version_select at 0x7fdfbe6c0940>, body: {"snapshot": {"volume_id": "ca9a5e47-1b76-48e0-b0ab-39d309b66597", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-265044594"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:24:32.785205 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-587f999f-e36f-46b7-8199-47e0803c1984 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.169230 Oct 01 04:24:32.785795 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 373/776] 10.222.0.26 () {60 vars in 1162 bytes} [Sat Oct 1 04:24:32 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:24:32.796889 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b006bf6b-7bdb-4f22-ae0d-681616858312 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] Calling method '.version_select at 0x7fdfbe625790>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:32.829032 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b006bf6b-7bdb-4f22-ae0d-681616858312 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/275e9dae-dcce-41f3-90d6-d6e7e37012ce" status: 200 len: 286 microversion: 2.1 time: 0.036112 Oct 01 04:24:32.829607 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 404/777] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 1 04:24:32 2022] GET /compute/v2.1/os-snapshots/275e9dae-dcce-41f3-90d6-d6e7e37012ce => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:24:32.841587 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cad7ed63-fa45-4393-91b8-3d572d5db960 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] Calling method '.version_select at 0x7fdfbe72bca0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:32.874110 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cad7ed63-fa45-4393-91b8-3d572d5db960 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.036399 Oct 01 04:24:32.874693 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 374/778] 10.222.0.26 () {58 vars in 1140 bytes} [Sat Oct 1 04:24:32 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:24:32.886811 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2fd8b35e-8fff-4eba-a03a-51082ce93f4a tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] Calling method '.version_select at 0x7fdfbe6258b0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:32.917349 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2fd8b35e-8fff-4eba-a03a-51082ce93f4a tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/275e9dae-dcce-41f3-90d6-d6e7e37012ce" status: 200 len: 286 microversion: 2.1 time: 0.034182 Oct 01 04:24:32.917965 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 405/779] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 1 04:24:32 2022] GET /compute/v2.1/os-snapshots/275e9dae-dcce-41f3-90d6-d6e7e37012ce => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:24:33.931041 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-723398f2-04f9-4611-a77d-e2e0794e254a tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] Calling method '.version_select at 0x7fdfbe7c1040>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:33.962038 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-723398f2-04f9-4611-a77d-e2e0794e254a tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/275e9dae-dcce-41f3-90d6-d6e7e37012ce" status: 200 len: 286 microversion: 2.1 time: 0.035956 Oct 01 04:24:33.962611 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 375/780] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 1 04:24:33 2022] GET /compute/v2.1/os-snapshots/275e9dae-dcce-41f3-90d6-d6e7e37012ce => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:24:34.976579 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-8045d00f-9845-4b8f-a803-83a8d574cd82 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] Calling method '.version_select at 0x7fdfbe66f4c0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:35.006807 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-8045d00f-9845-4b8f-a803-83a8d574cd82 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/275e9dae-dcce-41f3-90d6-d6e7e37012ce" status: 200 len: 286 microversion: 2.1 time: 0.035812 Oct 01 04:24:35.007470 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 406/781] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 1 04:24:34 2022] GET /compute/v2.1/os-snapshots/275e9dae-dcce-41f3-90d6-d6e7e37012ce => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:24:36.016763 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=5 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:36.022243 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2e8cce01-7ed7-4e28-99aa-1c1f08b19ab6 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] Calling method '.version_select at 0x7fdfbe6e4430>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:36.054574 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2e8cce01-7ed7-4e28-99aa-1c1f08b19ab6 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/275e9dae-dcce-41f3-90d6-d6e7e37012ce" status: 200 len: 286 microversion: 2.1 time: 0.038443 Oct 01 04:24:36.055148 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 376/782] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 1 04:24:36 2022] GET /compute/v2.1/os-snapshots/275e9dae-dcce-41f3-90d6-d6e7e37012ce => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:24:37.064759 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:37.065654 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=81 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:37.069964 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-47e26ff2-c31d-4c1a-9494-7ba728347299 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] Calling method '.version_select at 0x7fdfc218eb80>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:37.102274 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-47e26ff2-c31d-4c1a-9494-7ba728347299 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/275e9dae-dcce-41f3-90d6-d6e7e37012ce" status: 200 len: 287 microversion: 2.1 time: 0.038576 Oct 01 04:24:37.102845 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 407/783] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 1 04:24:37 2022] GET /compute/v2.1/os-snapshots/275e9dae-dcce-41f3-90d6-d6e7e37012ce => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:24:37.115130 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-541a25aa-dc49-497d-bd21-271ca757d575 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] Calling method '.version_select at 0x7fdfbe6cbb80>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:37.176033 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-541a25aa-dc49-497d-bd21-271ca757d575 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/275e9dae-dcce-41f3-90d6-d6e7e37012ce" status: 202 len: 0 microversion: 2.1 time: 0.065743 Oct 01 04:24:37.180596 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 377/784] 10.222.0.26 () {58 vars in 1254 bytes} [Sat Oct 1 04:24:37 2022] DELETE /compute/v2.1/os-snapshots/275e9dae-dcce-41f3-90d6-d6e7e37012ce => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 04:24:37.187177 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2e853f75-4f86-45f7-8f99-7b1c0f5b47b0 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] Calling method '.version_select at 0x7fdfc218ea60>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:37.219655 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2e853f75-4f86-45f7-8f99-7b1c0f5b47b0 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/275e9dae-dcce-41f3-90d6-d6e7e37012ce" status: 200 len: 286 microversion: 2.1 time: 0.037360 Oct 01 04:24:37.220237 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 408/785] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 1 04:24:37 2022] GET /compute/v2.1/os-snapshots/275e9dae-dcce-41f3-90d6-d6e7e37012ce => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:24:38.234081 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-890b534e-5e77-4729-841d-8d81df621f01 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] Calling method '.version_select at 0x7fdfbe6a94c0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:38.260710 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-890b534e-5e77-4729-841d-8d81df621f01 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] HTTP exception thrown: Snapshot 275e9dae-dcce-41f3-90d6-d6e7e37012ce could not be found. Oct 01 04:24:38.263454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-890b534e-5e77-4729-841d-8d81df621f01 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] Request method failure captured: Oct 01 04:24:38.263454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: request: GET /compute/v2.1/os-snapshots/275e9dae-dcce-41f3-90d6-d6e7e37012ce HTTP/1.1 Oct 01 04:24:38.263454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept: application/json Oct 01 04:24:38.263454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept-Encoding: identity Oct 01 04:24:38.263454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Connection: close Oct 01 04:24:38.263454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Length: 0 Oct 01 04:24:38.263454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Type: application/json Oct 01 04:24:38.263454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Host: 10.222.0.26 Oct 01 04:24:38.263454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 01 04:24:38.263454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 01 04:24:38.263454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjN8D-xPYrr1ZmTMIowPed1DuEqyLGpPpLnmUUcrGRn41_mevlFWx6Kc1si-JypWMUJKWL8-6T7sm0HqF-wm_Zk34-2qU36YEW0db-4uNJLgTd3nmhMG14f8IIp5Fr3CX-EeN-TOAhBKletMiFp3LLA-hAf9kSPat4zKa_s-zOtXAcL4c Oct 01 04:24:38.263454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Id: None Oct 01 04:24:38.263454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Name: None Oct 01 04:24:38.263454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 01 04:24:38.263454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 01 04:24:38.263454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 01 04:24:38.263454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 01 04:24:38.263454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Id: da8e7aa8a88d40dfbbecf0bc3f51ac5d Oct 01 04:24:38.263454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-511342392 Oct 01 04:24:38.263454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Role: reader,member Oct 01 04:24:38.263454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Roles: reader,member Oct 01 04:24:38.265055 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_da8e7aa8a88d40dfbbecf0bc3f51ac5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/da8e7aa8a88d40dfbbecf0bc3f51ac5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/da8e7aa8a88d40dfbbecf0bc3f51ac5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/da8e7aa8a88d40dfbbecf0bc3f51ac5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:24:38.265055 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant: tempest-VolumesSnapshotsTestJSON-511342392 Oct 01 04:24:38.265055 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Id: da8e7aa8a88d40dfbbecf0bc3f51ac5d Oct 01 04:24:38.265055 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-511342392 Oct 01 04:24:38.265055 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User: tempest-VolumesSnapshotsTestJSON-511342392-project Oct 01 04:24:38.265055 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 01 04:24:38.265055 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 01 04:24:38.265055 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Id: 4a73940f07a049b2b59e4ac333004d95 Oct 01 04:24:38.265055 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Name: tempest-VolumesSnapshotsTestJSON-511342392-project Oct 01 04:24:38.265055 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: method: Oct 01 04:24:38.265055 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: exception: Snapshot 275e9dae-dcce-41f3-90d6-d6e7e37012ce could not be found. Oct 01 04:24:38.265055 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: action_args: {'id': '275e9dae-dcce-41f3-90d6-d6e7e37012ce'} Oct 01 04:24:38.265055 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:24:38.266043 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:38.266043 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 01 04:24:38.266043 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 01 04:24:38.266043 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 01 04:24:38.266043 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 01 04:24:38.266043 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 01 04:24:38.266043 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 01 04:24:38.266043 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 01 04:24:38.266043 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 01 04:24:38.266043 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 01 04:24:38.266043 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 01 04:24:38.266043 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 04:24:38.266043 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 04:24:38.266043 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 04:24:38.266043 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 04:24:38.266043 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 275e9dae-dcce-41f3-90d6-d6e7e37012ce could not be found. (HTTP 404) (Request-ID: req-fdeb948d-012c-4817-b666-d9aa12177841) Oct 01 04:24:38.266043 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:24:38.266043 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:24:38.267221 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:24:38.267221 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:38.267221 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 01 04:24:38.267221 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 01 04:24:38.267221 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 01 04:24:38.267221 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 01 04:24:38.267221 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 01 04:24:38.267221 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 01 04:24:38.267221 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 01 04:24:38.267221 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 01 04:24:38.267221 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 01 04:24:38.267221 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 01 04:24:38.267221 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 01 04:24:38.267221 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 01 04:24:38.267221 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 01 04:24:38.267221 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 01 04:24:38.267221 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 01 04:24:38.267221 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 01 04:24:38.267221 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 01 04:24:38.268550 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 01 04:24:38.268550 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 04:24:38.268550 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 04:24:38.268550 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 04:24:38.268550 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 04:24:38.268550 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 275e9dae-dcce-41f3-90d6-d6e7e37012ce could not be found. Oct 01 04:24:38.268550 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:24:38.268550 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:24:38.268550 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:24:38.268550 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:38.268550 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:24:38.268550 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:24:38.268550 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:24:38.268550 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:24:38.268550 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 04:24:38.268550 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 04:24:38.268550 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:24:38.268550 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:24:38.268550 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 01 04:24:38.268550 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:24:38.270105 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 275e9dae-dcce-41f3-90d6-d6e7e37012ce could not be found. Oct 01 04:24:38.270105 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:24:38.270105 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:24:38.270105 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:24:38.270105 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:38.270105 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:24:38.270105 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:24:38.270105 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:24:38.270105 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:24:38.270105 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 275e9dae-dcce-41f3-90d6-d6e7e37012ce could not be found. Oct 01 04:24:38.270105 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:24:38.270105 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-890b534e-5e77-4729-841d-8d81df621f01 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] Returning 404 to user: Snapshot 275e9dae-dcce-41f3-90d6-d6e7e37012ce could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:24:38.270105 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-890b534e-5e77-4729-841d-8d81df621f01 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/275e9dae-dcce-41f3-90d6-d6e7e37012ce" status: 404 len: 111 microversion: 2.1 time: 0.035108 Oct 01 04:24:38.270105 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 378/786] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 1 04:24:38 2022] GET /compute/v2.1/os-snapshots/275e9dae-dcce-41f3-90d6-d6e7e37012ce => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:24:38.276035 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-31d18519-57bd-485a-b332-c6740c898809 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] Calling method '.version_select at 0x7fdfbe625b80>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:38.338293 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-31d18519-57bd-485a-b332-c6740c898809 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/ca9a5e47-1b76-48e0-b0ab-39d309b66597" status: 202 len: 0 microversion: 2.1 time: 0.066728 Oct 01 04:24:38.338860 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 409/787] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 1 04:24:38 2022] DELETE /compute/v2.1/os-volumes/ca9a5e47-1b76-48e0-b0ab-39d309b66597 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 01 04:24:38.347346 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-78fa3fa3-b13e-4b6b-8946-70c3c1c16992 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] Calling method '.version_select at 0x7fdfbe793280>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:38.396446 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-78fa3fa3-b13e-4b6b-8946-70c3c1c16992 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/ca9a5e47-1b76-48e0-b0ab-39d309b66597" status: 200 len: 345 microversion: 2.1 time: 0.052762 Oct 01 04:24:38.397042 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 379/788] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 1 04:24:38 2022] GET /compute/v2.1/os-volumes/ca9a5e47-1b76-48e0-b0ab-39d309b66597 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:24:39.411448 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f51755c5-12e8-4097-a56a-20149badf898 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] Calling method '.version_select at 0x7fdfc218ed30>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:39.439951 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-f51755c5-12e8-4097-a56a-20149badf898 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] HTTP exception thrown: Volume ca9a5e47-1b76-48e0-b0ab-39d309b66597 could not be found. Oct 01 04:24:39.441932 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f51755c5-12e8-4097-a56a-20149badf898 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] Request method failure captured: Oct 01 04:24:39.441932 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/os-volumes/ca9a5e47-1b76-48e0-b0ab-39d309b66597 HTTP/1.1 Oct 01 04:24:39.441932 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:24:39.441932 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:24:39.441932 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:24:39.441932 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 0 Oct 01 04:24:39.441932 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:24:39.441932 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:24:39.441932 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:24:39.441932 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:24:39.441932 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN8D-xPYrr1ZmTMIowPed1DuEqyLGpPpLnmUUcrGRn41_mevlFWx6Kc1si-JypWMUJKWL8-6T7sm0HqF-wm_Zk34-2qU36YEW0db-4uNJLgTd3nmhMG14f8IIp5Fr3CX-EeN-TOAhBKletMiFp3LLA-hAf9kSPat4zKa_s-zOtXAcL4c Oct 01 04:24:39.441932 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:24:39.441932 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:24:39.441932 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:24:39.441932 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:24:39.441932 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:24:39.441932 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:24:39.441932 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: da8e7aa8a88d40dfbbecf0bc3f51ac5d Oct 01 04:24:39.441932 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-511342392 Oct 01 04:24:39.441932 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:24:39.441932 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:24:39.443489 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_da8e7aa8a88d40dfbbecf0bc3f51ac5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/da8e7aa8a88d40dfbbecf0bc3f51ac5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/da8e7aa8a88d40dfbbecf0bc3f51ac5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/da8e7aa8a88d40dfbbecf0bc3f51ac5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:24:39.443489 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-VolumesSnapshotsTestJSON-511342392 Oct 01 04:24:39.443489 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: da8e7aa8a88d40dfbbecf0bc3f51ac5d Oct 01 04:24:39.443489 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-511342392 Oct 01 04:24:39.443489 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-VolumesSnapshotsTestJSON-511342392-project Oct 01 04:24:39.443489 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:24:39.443489 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:24:39.443489 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: 4a73940f07a049b2b59e4ac333004d95 Oct 01 04:24:39.443489 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-VolumesSnapshotsTestJSON-511342392-project Oct 01 04:24:39.443489 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: Oct 01 04:24:39.443489 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Volume ca9a5e47-1b76-48e0-b0ab-39d309b66597 could not be found. Oct 01 04:24:39.443489 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'id': 'ca9a5e47-1b76-48e0-b0ab-39d309b66597'} Oct 01 04:24:39.443489 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:24:39.445115 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:39.445115 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 04:24:39.445115 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 04:24:39.445115 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 01 04:24:39.445115 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 01 04:24:39.445115 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 01 04:24:39.445115 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 01 04:24:39.445115 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 01 04:24:39.445115 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 01 04:24:39.445115 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 01 04:24:39.445115 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 01 04:24:39.445115 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 04:24:39.445115 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 04:24:39.445115 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 04:24:39.445115 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 04:24:39.445115 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ca9a5e47-1b76-48e0-b0ab-39d309b66597 could not be found. (HTTP 404) (Request-ID: req-cd879986-4c8c-4cef-884d-fb3d5eacbbf4) Oct 01 04:24:39.445115 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:24:39.445115 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:24:39.445115 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:24:39.446558 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:39.446558 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 01 04:24:39.446558 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 01 04:24:39.446558 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 01 04:24:39.446558 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 01 04:24:39.446558 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 01 04:24:39.446558 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 01 04:24:39.446558 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 01 04:24:39.446558 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 01 04:24:39.446558 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 04:24:39.446558 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 04:24:39.446558 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 01 04:24:39.446558 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 01 04:24:39.446558 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 01 04:24:39.446558 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 01 04:24:39.446558 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 01 04:24:39.446558 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 01 04:24:39.446558 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 01 04:24:39.446558 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 01 04:24:39.448047 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 04:24:39.448047 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 04:24:39.448047 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 04:24:39.448047 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 04:24:39.448047 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ca9a5e47-1b76-48e0-b0ab-39d309b66597 could not be found. Oct 01 04:24:39.448047 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:24:39.448047 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:24:39.448047 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:24:39.448047 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:39.448047 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:24:39.448047 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:24:39.448047 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:24:39.448047 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:24:39.448047 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 04:24:39.448047 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 04:24:39.448047 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:24:39.448047 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:24:39.448047 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 01 04:24:39.448047 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:24:39.449434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ca9a5e47-1b76-48e0-b0ab-39d309b66597 could not be found. Oct 01 04:24:39.449434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:24:39.449434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:24:39.449434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:24:39.449434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:39.449434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:24:39.449434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:24:39.449434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:24:39.449434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:24:39.449434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ca9a5e47-1b76-48e0-b0ab-39d309b66597 could not be found. Oct 01 04:24:39.449434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:24:39.449434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f51755c5-12e8-4097-a56a-20149badf898 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] Returning 404 to user: Volume ca9a5e47-1b76-48e0-b0ab-39d309b66597 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:24:39.449434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f51755c5-12e8-4097-a56a-20149badf898 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/ca9a5e47-1b76-48e0-b0ab-39d309b66597" status: 404 len: 109 microversion: 2.1 time: 0.036237 Oct 01 04:24:39.449434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 410/789] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 1 04:24:39 2022] GET /compute/v2.1/os-volumes/ca9a5e47-1b76-48e0-b0ab-39d309b66597 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:24:39.455346 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:39.456289 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:39.461541 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e6f9dce0-20d3-4e8d-915f-d59f76e426f5 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] Calling method '.version_select at 0x7fdfbe6b9160>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:39.491317 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-e6f9dce0-20d3-4e8d-915f-d59f76e426f5 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] HTTP exception thrown: Volume ca9a5e47-1b76-48e0-b0ab-39d309b66597 could not be found. Oct 01 04:24:39.493566 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e6f9dce0-20d3-4e8d-915f-d59f76e426f5 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] Request method failure captured: Oct 01 04:24:39.493566 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: request: DELETE /compute/v2.1/os-volumes/ca9a5e47-1b76-48e0-b0ab-39d309b66597 HTTP/1.1 Oct 01 04:24:39.493566 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept: application/json Oct 01 04:24:39.493566 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept-Encoding: identity Oct 01 04:24:39.493566 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Connection: close Oct 01 04:24:39.493566 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Length: 0 Oct 01 04:24:39.493566 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Type: application/json Oct 01 04:24:39.493566 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Host: 10.222.0.26 Oct 01 04:24:39.493566 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 01 04:24:39.493566 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 01 04:24:39.493566 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjN8D-xPYrr1ZmTMIowPed1DuEqyLGpPpLnmUUcrGRn41_mevlFWx6Kc1si-JypWMUJKWL8-6T7sm0HqF-wm_Zk34-2qU36YEW0db-4uNJLgTd3nmhMG14f8IIp5Fr3CX-EeN-TOAhBKletMiFp3LLA-hAf9kSPat4zKa_s-zOtXAcL4c Oct 01 04:24:39.493566 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Id: None Oct 01 04:24:39.493566 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Name: None Oct 01 04:24:39.493566 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 01 04:24:39.493566 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 01 04:24:39.493566 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 01 04:24:39.493566 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 01 04:24:39.493566 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Id: da8e7aa8a88d40dfbbecf0bc3f51ac5d Oct 01 04:24:39.493566 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-511342392 Oct 01 04:24:39.493566 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Role: reader,member Oct 01 04:24:39.493566 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Roles: reader,member Oct 01 04:24:39.495130 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_da8e7aa8a88d40dfbbecf0bc3f51ac5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/da8e7aa8a88d40dfbbecf0bc3f51ac5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/da8e7aa8a88d40dfbbecf0bc3f51ac5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/da8e7aa8a88d40dfbbecf0bc3f51ac5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:24:39.495130 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant: tempest-VolumesSnapshotsTestJSON-511342392 Oct 01 04:24:39.495130 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Id: da8e7aa8a88d40dfbbecf0bc3f51ac5d Oct 01 04:24:39.495130 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-511342392 Oct 01 04:24:39.495130 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User: tempest-VolumesSnapshotsTestJSON-511342392-project Oct 01 04:24:39.495130 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 01 04:24:39.495130 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 01 04:24:39.495130 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Id: 4a73940f07a049b2b59e4ac333004d95 Oct 01 04:24:39.495130 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Name: tempest-VolumesSnapshotsTestJSON-511342392-project Oct 01 04:24:39.495130 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: method: Oct 01 04:24:39.495130 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: exception: Volume ca9a5e47-1b76-48e0-b0ab-39d309b66597 could not be found. Oct 01 04:24:39.495130 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: action_args: {'id': 'ca9a5e47-1b76-48e0-b0ab-39d309b66597'} Oct 01 04:24:39.495130 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:24:39.496086 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:39.496086 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 04:24:39.496086 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 04:24:39.496086 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 01 04:24:39.496086 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 01 04:24:39.496086 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 01 04:24:39.496086 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 01 04:24:39.496086 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 01 04:24:39.496086 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 01 04:24:39.496086 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 01 04:24:39.496086 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 01 04:24:39.496086 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 04:24:39.496086 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 04:24:39.496086 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 04:24:39.496086 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 04:24:39.496086 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ca9a5e47-1b76-48e0-b0ab-39d309b66597 could not be found. (HTTP 404) (Request-ID: req-28d8f4ba-0f75-4132-a505-74934bee5627) Oct 01 04:24:39.496086 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:24:39.496086 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:24:39.496086 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:24:39.497724 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:39.497724 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 01 04:24:39.497724 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 01 04:24:39.497724 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 01 04:24:39.497724 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 01 04:24:39.497724 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 01 04:24:39.497724 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 01 04:24:39.497724 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 01 04:24:39.497724 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 01 04:24:39.497724 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 04:24:39.497724 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 04:24:39.497724 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 01 04:24:39.497724 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 01 04:24:39.497724 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 01 04:24:39.497724 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 01 04:24:39.497724 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 01 04:24:39.497724 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 01 04:24:39.497724 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 01 04:24:39.497724 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 01 04:24:39.499393 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 04:24:39.499393 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 04:24:39.499393 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 04:24:39.499393 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 04:24:39.499393 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ca9a5e47-1b76-48e0-b0ab-39d309b66597 could not be found. Oct 01 04:24:39.499393 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:24:39.499393 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:24:39.499393 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:24:39.499393 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:39.499393 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:24:39.499393 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:24:39.499393 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:24:39.499393 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:24:39.499393 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 04:24:39.499393 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 04:24:39.499393 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:24:39.499393 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:24:39.499393 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 01 04:24:39.499393 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:24:39.500822 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ca9a5e47-1b76-48e0-b0ab-39d309b66597 could not be found. Oct 01 04:24:39.500822 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:24:39.500822 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:24:39.500822 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:24:39.500822 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:39.500822 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:24:39.500822 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:24:39.500822 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:24:39.500822 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:24:39.500822 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ca9a5e47-1b76-48e0-b0ab-39d309b66597 could not be found. Oct 01 04:24:39.500822 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:24:39.500822 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e6f9dce0-20d3-4e8d-915f-d59f76e426f5 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] Returning 404 to user: Volume ca9a5e47-1b76-48e0-b0ab-39d309b66597 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:24:39.500822 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e6f9dce0-20d3-4e8d-915f-d59f76e426f5 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/ca9a5e47-1b76-48e0-b0ab-39d309b66597" status: 404 len: 109 microversion: 2.1 time: 0.040845 Oct 01 04:24:39.500822 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 380/790] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 1 04:24:39 2022] DELETE /compute/v2.1/os-volumes/ca9a5e47-1b76-48e0-b0ab-39d309b66597 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:24:39.504242 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-85d8a15c-7fb9-4c4e-b5a9-ddc3820dc6a9 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] Calling method '.version_select at 0x7fdfbe66f310>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:39.534384 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-85d8a15c-7fb9-4c4e-b5a9-ddc3820dc6a9 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] HTTP exception thrown: Volume ca9a5e47-1b76-48e0-b0ab-39d309b66597 could not be found. Oct 01 04:24:39.536326 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-85d8a15c-7fb9-4c4e-b5a9-ddc3820dc6a9 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] Request method failure captured: Oct 01 04:24:39.536326 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/os-volumes/ca9a5e47-1b76-48e0-b0ab-39d309b66597 HTTP/1.1 Oct 01 04:24:39.536326 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:24:39.536326 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:24:39.536326 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:24:39.536326 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 0 Oct 01 04:24:39.536326 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:24:39.536326 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:24:39.536326 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:24:39.536326 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:24:39.536326 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN8D-xPYrr1ZmTMIowPed1DuEqyLGpPpLnmUUcrGRn41_mevlFWx6Kc1si-JypWMUJKWL8-6T7sm0HqF-wm_Zk34-2qU36YEW0db-4uNJLgTd3nmhMG14f8IIp5Fr3CX-EeN-TOAhBKletMiFp3LLA-hAf9kSPat4zKa_s-zOtXAcL4c Oct 01 04:24:39.536326 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:24:39.536326 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:24:39.536326 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:24:39.536326 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:24:39.536326 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:24:39.536326 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:24:39.536326 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: da8e7aa8a88d40dfbbecf0bc3f51ac5d Oct 01 04:24:39.536326 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-511342392 Oct 01 04:24:39.536326 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:24:39.536326 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:24:39.538546 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_da8e7aa8a88d40dfbbecf0bc3f51ac5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/da8e7aa8a88d40dfbbecf0bc3f51ac5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/da8e7aa8a88d40dfbbecf0bc3f51ac5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/da8e7aa8a88d40dfbbecf0bc3f51ac5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:24:39.538546 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-VolumesSnapshotsTestJSON-511342392 Oct 01 04:24:39.538546 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: da8e7aa8a88d40dfbbecf0bc3f51ac5d Oct 01 04:24:39.538546 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-511342392 Oct 01 04:24:39.538546 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-VolumesSnapshotsTestJSON-511342392-project Oct 01 04:24:39.538546 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:24:39.538546 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:24:39.538546 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: 4a73940f07a049b2b59e4ac333004d95 Oct 01 04:24:39.538546 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-VolumesSnapshotsTestJSON-511342392-project Oct 01 04:24:39.538546 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: Oct 01 04:24:39.538546 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Volume ca9a5e47-1b76-48e0-b0ab-39d309b66597 could not be found. Oct 01 04:24:39.538546 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'id': 'ca9a5e47-1b76-48e0-b0ab-39d309b66597'} Oct 01 04:24:39.538546 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:24:39.539415 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:39.539415 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 04:24:39.539415 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 04:24:39.539415 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 01 04:24:39.539415 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 01 04:24:39.539415 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 01 04:24:39.539415 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 01 04:24:39.539415 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 01 04:24:39.539415 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 01 04:24:39.539415 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 01 04:24:39.539415 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 01 04:24:39.539415 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 04:24:39.539415 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 04:24:39.539415 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 04:24:39.539415 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 04:24:39.539415 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ca9a5e47-1b76-48e0-b0ab-39d309b66597 could not be found. (HTTP 404) (Request-ID: req-92eca9fe-5236-4188-922e-9a378153b427) Oct 01 04:24:39.539415 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:24:39.539415 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:24:39.539415 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:24:39.541007 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:39.541007 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 01 04:24:39.541007 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 01 04:24:39.541007 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 01 04:24:39.541007 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 01 04:24:39.541007 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 01 04:24:39.541007 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 01 04:24:39.541007 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 01 04:24:39.541007 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 01 04:24:39.541007 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 01 04:24:39.541007 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 01 04:24:39.541007 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 01 04:24:39.541007 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 01 04:24:39.541007 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 01 04:24:39.541007 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 01 04:24:39.541007 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 01 04:24:39.541007 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 01 04:24:39.541007 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 01 04:24:39.541007 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 01 04:24:39.542799 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 01 04:24:39.542799 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 01 04:24:39.542799 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 01 04:24:39.542799 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 01 04:24:39.542799 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ca9a5e47-1b76-48e0-b0ab-39d309b66597 could not be found. Oct 01 04:24:39.542799 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:24:39.542799 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:24:39.542799 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:24:39.542799 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:39.542799 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:24:39.542799 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:24:39.542799 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:24:39.542799 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:24:39.542799 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 01 04:24:39.542799 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 01 04:24:39.542799 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:24:39.542799 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:24:39.542799 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 01 04:24:39.542799 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:24:39.544154 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ca9a5e47-1b76-48e0-b0ab-39d309b66597 could not be found. Oct 01 04:24:39.544154 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:24:39.544154 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:24:39.544154 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:24:39.544154 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:24:39.544154 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:24:39.544154 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:24:39.544154 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:24:39.544154 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:24:39.544154 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ca9a5e47-1b76-48e0-b0ab-39d309b66597 could not be found. Oct 01 04:24:39.544154 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:24:39.544154 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-85d8a15c-7fb9-4c4e-b5a9-ddc3820dc6a9 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] Returning 404 to user: Volume ca9a5e47-1b76-48e0-b0ab-39d309b66597 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:24:39.544154 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-85d8a15c-7fb9-4c4e-b5a9-ddc3820dc6a9 tempest-VolumesSnapshotsTestJSON-511342392 tempest-VolumesSnapshotsTestJSON-511342392-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/ca9a5e47-1b76-48e0-b0ab-39d309b66597" status: 404 len: 109 microversion: 2.1 time: 0.037350 Oct 01 04:24:39.544154 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 411/791] 10.222.0.26 () {58 vars in 1245 bytes} [Sat Oct 1 04:24:39 2022] GET /compute/v2.1/os-volumes/ca9a5e47-1b76-48e0-b0ab-39d309b66597 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:24:47.344995 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d78be143-1643-4faa-bd55-75df10c0c1a3 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1994542564", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-169677656", "security_groups": [{"name": "tempest-secgroup-smoke-1348309530"}], "networks": [{"uuid": "dfb1f66d-4f49-4f84-9a12-ceecfc8e716b"}], "block_device_mapping_v2": [{"uuid": "212a3b76-2e72-4580-88de-ff9d7aebbf30", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:24:47.457306 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-d78be143-1643-4faa-bd55-75df10c0c1a3 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] validate_networks() for [('dfb1f66d-4f49-4f84-9a12-ceecfc8e716b', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 04:24:47.855803 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-d78be143-1643-4faa-bd55-75df10c0c1a3 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 04:24:47.856339 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-d78be143-1643-4faa-bd55-75df10c0c1a3 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 04:24:47.857093 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-d78be143-1643-4faa-bd55-75df10c0c1a3 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 04:24:47.857567 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-d78be143-1643-4faa-bd55-75df10c0c1a3 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 04:24:47.858061 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-d78be143-1643-4faa-bd55-75df10c0c1a3 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 04:24:47.869960 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d78be143-1643-4faa-bd55-75df10c0c1a3 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:47.870446 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d78be143-1643-4faa-bd55-75df10c0c1a3 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:47.870877 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d78be143-1643-4faa-bd55-75df10c0c1a3 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:47.871602 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d78be143-1643-4faa-bd55-75df10c0c1a3 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:47.872058 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d78be143-1643-4faa-bd55-75df10c0c1a3 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:47.872483 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d78be143-1643-4faa-bd55-75df10c0c1a3 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:47.892776 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-d78be143-1643-4faa-bd55-75df10c0c1a3 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Getting quotas for project 1eda12202e6f439b96a87a81d7531503. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:24:47.898102 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-d78be143-1643-4faa-bd55-75df10c0c1a3 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Getting quotas for user 944a3ab108184d5ab8784e21805f9873 and project 1eda12202e6f439b96a87a81d7531503. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:24:47.964107 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d78be143-1643-4faa-bd55-75df10c0c1a3 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 04:24:47.966304 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d78be143-1643-4faa-bd55-75df10c0c1a3 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='212a3b76-2e72-4580-88de-ff9d7aebbf30',volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 04:24:48.098769 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d78be143-1643-4faa-bd55-75df10c0c1a3 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.758320 Oct 01 04:24:48.099368 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 381/792] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 1 04:24:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 04:24:48.111299 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d31789aa-add2-4955-9a8d-61dbf4d76b2b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:48.111928 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d31789aa-add2-4955-9a8d-61dbf4d76b2b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:48.168742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d31789aa-add2-4955-9a8d-61dbf4d76b2b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:48.176199 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d31789aa-add2-4955-9a8d-61dbf4d76b2b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1088 microversion: 2.1 time: 0.069504 Oct 01 04:24:48.176775 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 412/793] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:48 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:49.200083 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c5892027-fe7e-420c-8826-e87d31095dc7 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:49.200705 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c5892027-fe7e-420c-8826-e87d31095dc7 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:49.208085 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5892027-fe7e-420c-8826-e87d31095dc7 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:49.208883 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5892027-fe7e-420c-8826-e87d31095dc7 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:49.209947 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5892027-fe7e-420c-8826-e87d31095dc7 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:49.210908 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5892027-fe7e-420c-8826-e87d31095dc7 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:49.211543 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5892027-fe7e-420c-8826-e87d31095dc7 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:49.212198 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c5892027-fe7e-420c-8826-e87d31095dc7 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:49.281392 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c5892027-fe7e-420c-8826-e87d31095dc7 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:49.290714 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c5892027-fe7e-420c-8826-e87d31095dc7 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1204 microversion: 2.1 time: 0.094586 Oct 01 04:24:49.291625 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 382/794] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:49 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1204 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:50.315345 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-37c094e2-919d-459c-aafe-525403b7951f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:50.315924 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-37c094e2-919d-459c-aafe-525403b7951f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:50.323135 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37c094e2-919d-459c-aafe-525403b7951f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:50.323623 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37c094e2-919d-459c-aafe-525403b7951f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:50.324061 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37c094e2-919d-459c-aafe-525403b7951f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:50.324753 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37c094e2-919d-459c-aafe-525403b7951f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:50.325246 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37c094e2-919d-459c-aafe-525403b7951f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:50.325673 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37c094e2-919d-459c-aafe-525403b7951f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:50.451516 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-37c094e2-919d-459c-aafe-525403b7951f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:50.459057 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-37c094e2-919d-459c-aafe-525403b7951f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1272 microversion: 2.1 time: 0.148042 Oct 01 04:24:50.460215 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 413/795] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:50 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1272 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:51.482309 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9edb571c-bda5-4834-9a9c-dc0d89b1c8a9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:51.482960 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9edb571c-bda5-4834-9a9c-dc0d89b1c8a9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:51.489279 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9edb571c-bda5-4834-9a9c-dc0d89b1c8a9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:51.489771 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9edb571c-bda5-4834-9a9c-dc0d89b1c8a9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:51.490210 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9edb571c-bda5-4834-9a9c-dc0d89b1c8a9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:51.490944 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9edb571c-bda5-4834-9a9c-dc0d89b1c8a9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:51.491504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9edb571c-bda5-4834-9a9c-dc0d89b1c8a9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:51.491936 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9edb571c-bda5-4834-9a9c-dc0d89b1c8a9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:51.626304 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-9edb571c-bda5-4834-9a9c-dc0d89b1c8a9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:51.635441 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9edb571c-bda5-4834-9a9c-dc0d89b1c8a9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1272 microversion: 2.1 time: 0.156992 Oct 01 04:24:51.636029 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 383/796] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:51 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:51.965154 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-9a66deca-84b7-4b05-9d85-b81fc85acdaa req-ac808def-0a01-4e31-8f12-ae6e50664fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2af93c94-483f-4f6d-a017-d45ef01bac8d", "tag": "ff800efd-217a-4aea-84a5-e5f05dd17b62"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:24:51.975778 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9a66deca-84b7-4b05-9d85-b81fc85acdaa req-ac808def-0a01-4e31-8f12-ae6e50664fc5 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:51.976254 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9a66deca-84b7-4b05-9d85-b81fc85acdaa req-ac808def-0a01-4e31-8f12-ae6e50664fc5 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:51.976682 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-9a66deca-84b7-4b05-9d85-b81fc85acdaa req-ac808def-0a01-4e31-8f12-ae6e50664fc5 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:51.988567 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-9a66deca-84b7-4b05-9d85-b81fc85acdaa req-ac808def-0a01-4e31-8f12-ae6e50664fc5 service nova] Creating event network-changed:ff800efd-217a-4aea-84a5-e5f05dd17b62 for instance 2af93c94-483f-4f6d-a017-d45ef01bac8d on hv-cinder-86004 Oct 01 04:24:51.993895 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-9a66deca-84b7-4b05-9d85-b81fc85acdaa req-ac808def-0a01-4e31-8f12-ae6e50664fc5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032692 Oct 01 04:24:51.994697 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 414/797] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:24:52.659905 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-51461d3c-f07c-4150-bab6-e7e42793e44e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:52.660662 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-51461d3c-f07c-4150-bab6-e7e42793e44e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:52.667502 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-51461d3c-f07c-4150-bab6-e7e42793e44e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:52.668015 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-51461d3c-f07c-4150-bab6-e7e42793e44e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:52.668457 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-51461d3c-f07c-4150-bab6-e7e42793e44e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:52.670811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-51461d3c-f07c-4150-bab6-e7e42793e44e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:52.670811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-51461d3c-f07c-4150-bab6-e7e42793e44e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:52.670811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-51461d3c-f07c-4150-bab6-e7e42793e44e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:52.817297 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-51461d3c-f07c-4150-bab6-e7e42793e44e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:52.826368 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-51461d3c-f07c-4150-bab6-e7e42793e44e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1272 microversion: 2.1 time: 0.170431 Oct 01 04:24:52.839269 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 384/798] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:52 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1272 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:53.856001 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9f33d3e7-bb9c-4187-9edd-1e89d2c125b0 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:53.856615 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9f33d3e7-bb9c-4187-9edd-1e89d2c125b0 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:53.862752 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f33d3e7-bb9c-4187-9edd-1e89d2c125b0 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:53.863232 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f33d3e7-bb9c-4187-9edd-1e89d2c125b0 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:53.863665 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f33d3e7-bb9c-4187-9edd-1e89d2c125b0 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:53.864356 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f33d3e7-bb9c-4187-9edd-1e89d2c125b0 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:53.864816 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f33d3e7-bb9c-4187-9edd-1e89d2c125b0 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:53.865296 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9f33d3e7-bb9c-4187-9edd-1e89d2c125b0 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:54.003534 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-9f33d3e7-bb9c-4187-9edd-1e89d2c125b0 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:54.011462 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9f33d3e7-bb9c-4187-9edd-1e89d2c125b0 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1260 microversion: 2.1 time: 0.160289 Oct 01 04:24:54.012045 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 415/799] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:53 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:55.037965 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8d1322b7-176b-4f49-89af-dcf6561d2476 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:55.038524 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8d1322b7-176b-4f49-89af-dcf6561d2476 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:55.045019 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d1322b7-176b-4f49-89af-dcf6561d2476 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:55.045505 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d1322b7-176b-4f49-89af-dcf6561d2476 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:55.045942 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d1322b7-176b-4f49-89af-dcf6561d2476 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:55.046630 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d1322b7-176b-4f49-89af-dcf6561d2476 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:55.047087 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d1322b7-176b-4f49-89af-dcf6561d2476 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:55.047517 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8d1322b7-176b-4f49-89af-dcf6561d2476 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:55.178778 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-8d1322b7-176b-4f49-89af-dcf6561d2476 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:55.186398 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8d1322b7-176b-4f49-89af-dcf6561d2476 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1260 microversion: 2.1 time: 0.152896 Oct 01 04:24:55.186971 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 385/800] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:55 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:24:56.209162 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-ef5f7c49-dacf-43d8-a69e-1dabddb3bdee tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:56.210459 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-ef5f7c49-dacf-43d8-a69e-1dabddb3bdee tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:56.217193 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef5f7c49-dacf-43d8-a69e-1dabddb3bdee tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:56.217677 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef5f7c49-dacf-43d8-a69e-1dabddb3bdee tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:56.218302 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef5f7c49-dacf-43d8-a69e-1dabddb3bdee tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:56.219000 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef5f7c49-dacf-43d8-a69e-1dabddb3bdee tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:56.219456 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef5f7c49-dacf-43d8-a69e-1dabddb3bdee tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:56.220078 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-ef5f7c49-dacf-43d8-a69e-1dabddb3bdee tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:56.386894 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-ef5f7c49-dacf-43d8-a69e-1dabddb3bdee tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:56.404386 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-ef5f7c49-dacf-43d8-a69e-1dabddb3bdee tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1260 microversion: 2.1 time: 0.199045 Oct 01 04:24:56.406243 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 416/801] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:56 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1260 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:24:57.433900 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-61e47969-75d6-4962-85c8-720842385355 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:57.434636 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-61e47969-75d6-4962-85c8-720842385355 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:57.443763 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61e47969-75d6-4962-85c8-720842385355 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:57.444953 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61e47969-75d6-4962-85c8-720842385355 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:57.445397 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61e47969-75d6-4962-85c8-720842385355 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:57.446124 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61e47969-75d6-4962-85c8-720842385355 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:57.446587 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61e47969-75d6-4962-85c8-720842385355 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:57.447170 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-61e47969-75d6-4962-85c8-720842385355 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:57.620952 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-61e47969-75d6-4962-85c8-720842385355 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:57.631960 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-61e47969-75d6-4962-85c8-720842385355 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1260 microversion: 2.1 time: 0.206801 Oct 01 04:24:57.632466 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 386/802] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:57 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1260 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:58.655775 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-45713ad7-93a5-48e5-ad3d-52f3a620276e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:58.656436 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-45713ad7-93a5-48e5-ad3d-52f3a620276e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:58.658339 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:58.664346 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45713ad7-93a5-48e5-ad3d-52f3a620276e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:58.664961 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45713ad7-93a5-48e5-ad3d-52f3a620276e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:58.665467 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45713ad7-93a5-48e5-ad3d-52f3a620276e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:58.666691 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45713ad7-93a5-48e5-ad3d-52f3a620276e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:58.667275 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45713ad7-93a5-48e5-ad3d-52f3a620276e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:58.667766 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-45713ad7-93a5-48e5-ad3d-52f3a620276e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:58.804141 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-45713ad7-93a5-48e5-ad3d-52f3a620276e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:24:58.811777 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-45713ad7-93a5-48e5-ad3d-52f3a620276e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1260 microversion: 2.1 time: 0.160094 Oct 01 04:24:58.812388 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 417/803] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:58 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:24:59.835846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a5b4d630-ba1b-496a-b9c9-682295580faa tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:24:59.836387 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a5b4d630-ba1b-496a-b9c9-682295580faa tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:24:59.838263 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:59.839005 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:24:59.845376 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5b4d630-ba1b-496a-b9c9-682295580faa tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:59.845873 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5b4d630-ba1b-496a-b9c9-682295580faa tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:59.846317 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5b4d630-ba1b-496a-b9c9-682295580faa tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:59.847021 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5b4d630-ba1b-496a-b9c9-682295580faa tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:24:59.847487 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5b4d630-ba1b-496a-b9c9-682295580faa tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:24:59.847930 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5b4d630-ba1b-496a-b9c9-682295580faa tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:24:59.997111 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-a5b4d630-ba1b-496a-b9c9-682295580faa tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:00.004901 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a5b4d630-ba1b-496a-b9c9-682295580faa tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1260 microversion: 2.1 time: 0.173233 Oct 01 04:25:00.005523 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 387/804] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:24:59 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:01.028745 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a43872ec-eec8-4518-8bfb-9a9ce41426f6 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:01.029309 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a43872ec-eec8-4518-8bfb-9a9ce41426f6 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:01.036596 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a43872ec-eec8-4518-8bfb-9a9ce41426f6 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:01.037888 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a43872ec-eec8-4518-8bfb-9a9ce41426f6 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:01.038154 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a43872ec-eec8-4518-8bfb-9a9ce41426f6 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:01.038840 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a43872ec-eec8-4518-8bfb-9a9ce41426f6 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:01.039289 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a43872ec-eec8-4518-8bfb-9a9ce41426f6 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:01.039708 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a43872ec-eec8-4518-8bfb-9a9ce41426f6 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:01.179243 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a43872ec-eec8-4518-8bfb-9a9ce41426f6 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:01.187697 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a43872ec-eec8-4518-8bfb-9a9ce41426f6 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1260 microversion: 2.1 time: 0.162810 Oct 01 04:25:01.188268 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 418/805] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:01 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:02.211295 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d8f7c7f9-3afd-439c-bac0-20818bb87968 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:02.211814 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d8f7c7f9-3afd-439c-bac0-20818bb87968 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:02.218365 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8f7c7f9-3afd-439c-bac0-20818bb87968 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:02.218851 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8f7c7f9-3afd-439c-bac0-20818bb87968 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:02.219285 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8f7c7f9-3afd-439c-bac0-20818bb87968 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:02.220202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8f7c7f9-3afd-439c-bac0-20818bb87968 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:02.220556 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8f7c7f9-3afd-439c-bac0-20818bb87968 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:02.221010 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d8f7c7f9-3afd-439c-bac0-20818bb87968 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:02.363529 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-d8f7c7f9-3afd-439c-bac0-20818bb87968 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:02.372516 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d8f7c7f9-3afd-439c-bac0-20818bb87968 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1260 microversion: 2.1 time: 0.165942 Oct 01 04:25:02.373116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 388/806] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:02 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:02.420783 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-20eb4174-6713-4d30-997e-d509a9312647 req-2998e95a-42d8-429f-8a47-5bb12c8e242f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af93c94-483f-4f6d-a017-d45ef01bac8d", "name": "network-vif-plugged", "status": "completed", "tag": "ff800efd-217a-4aea-84a5-e5f05dd17b62"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:25:02.432302 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-20eb4174-6713-4d30-997e-d509a9312647 req-2998e95a-42d8-429f-8a47-5bb12c8e242f service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:02.433014 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-20eb4174-6713-4d30-997e-d509a9312647 req-2998e95a-42d8-429f-8a47-5bb12c8e242f service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:02.433627 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-20eb4174-6713-4d30-997e-d509a9312647 req-2998e95a-42d8-429f-8a47-5bb12c8e242f service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:02.447699 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-20eb4174-6713-4d30-997e-d509a9312647 req-2998e95a-42d8-429f-8a47-5bb12c8e242f service nova] Creating event network-vif-plugged:ff800efd-217a-4aea-84a5-e5f05dd17b62 for instance 2af93c94-483f-4f6d-a017-d45ef01bac8d on hv-cinder-86004 Oct 01 04:25:02.452670 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-20eb4174-6713-4d30-997e-d509a9312647 req-2998e95a-42d8-429f-8a47-5bb12c8e242f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035574 Oct 01 04:25:02.453290 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 419/807] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:25:02.459688 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-631c8b3d-7a5a-4cb9-8126-773da073ad4a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:02.471251 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-631c8b3d-7a5a-4cb9-8126-773da073ad4a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:02.478666 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-631c8b3d-7a5a-4cb9-8126-773da073ad4a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:02.479196 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-631c8b3d-7a5a-4cb9-8126-773da073ad4a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:02.479846 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-631c8b3d-7a5a-4cb9-8126-773da073ad4a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:02.480734 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-631c8b3d-7a5a-4cb9-8126-773da073ad4a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:02.481228 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-631c8b3d-7a5a-4cb9-8126-773da073ad4a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:02.481989 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-631c8b3d-7a5a-4cb9-8126-773da073ad4a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:02.513540 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-631c8b3d-7a5a-4cb9-8126-773da073ad4a tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057780 Oct 01 04:25:02.514044 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 389/808] 10.222.0.26 () {60 vars in 1343 bytes} [Sat Oct 1 04:25:02 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:02.596548 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0e52f9a0-39fe-46a0-9250-75f0ccf0551c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:02.597466 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0e52f9a0-39fe-46a0-9250-75f0ccf0551c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:02.604479 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e52f9a0-39fe-46a0-9250-75f0ccf0551c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:02.605311 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e52f9a0-39fe-46a0-9250-75f0ccf0551c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:02.605970 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e52f9a0-39fe-46a0-9250-75f0ccf0551c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:02.606930 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e52f9a0-39fe-46a0-9250-75f0ccf0551c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:02.607854 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e52f9a0-39fe-46a0-9250-75f0ccf0551c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:02.608495 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0e52f9a0-39fe-46a0-9250-75f0ccf0551c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:02.647820 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0e52f9a0-39fe-46a0-9250-75f0ccf0551c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 04:25:02.736470 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0e52f9a0-39fe-46a0-9250-75f0ccf0551c tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 204 len: 0 microversion: 2.20 time: 0.143884 Oct 01 04:25:02.737687 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 420/809] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 1 04:25:02 2022] DELETE /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 04:25:02.747532 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-adbac5ed-b45b-49ac-9497-e7ef6539e8d8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:02.748211 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-adbac5ed-b45b-49ac-9497-e7ef6539e8d8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:02.754735 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-adbac5ed-b45b-49ac-9497-e7ef6539e8d8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:02.755235 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-adbac5ed-b45b-49ac-9497-e7ef6539e8d8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:02.755921 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-adbac5ed-b45b-49ac-9497-e7ef6539e8d8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:02.756724 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-adbac5ed-b45b-49ac-9497-e7ef6539e8d8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:02.757242 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-adbac5ed-b45b-49ac-9497-e7ef6539e8d8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:02.757680 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-adbac5ed-b45b-49ac-9497-e7ef6539e8d8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:02.900026 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-adbac5ed-b45b-49ac-9497-e7ef6539e8d8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:02.908140 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-adbac5ed-b45b-49ac-9497-e7ef6539e8d8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:02.909724 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-adbac5ed-b45b-49ac-9497-e7ef6539e8d8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:02.910964 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-adbac5ed-b45b-49ac-9497-e7ef6539e8d8 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1725 microversion: 2.20 time: 0.167357 Oct 01 04:25:02.911802 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 390/810] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:25:02 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:25:03.397220 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3aeb2942-a1fe-4e83-bacb-316a4a3963d9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:03.398218 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3aeb2942-a1fe-4e83-bacb-316a4a3963d9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:03.404056 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3aeb2942-a1fe-4e83-bacb-316a4a3963d9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:03.404549 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3aeb2942-a1fe-4e83-bacb-316a4a3963d9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:03.405017 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3aeb2942-a1fe-4e83-bacb-316a4a3963d9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:03.405718 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3aeb2942-a1fe-4e83-bacb-316a4a3963d9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:03.406180 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3aeb2942-a1fe-4e83-bacb-316a4a3963d9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:03.406612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3aeb2942-a1fe-4e83-bacb-316a4a3963d9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:03.545318 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-3aeb2942-a1fe-4e83-bacb-316a4a3963d9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:03.553789 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3aeb2942-a1fe-4e83-bacb-316a4a3963d9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1260 microversion: 2.1 time: 0.161862 Oct 01 04:25:03.554501 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 421/811] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:03 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:03.937286 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8e32d1d0-d3c9-41cd-bd66-f996f34c49a5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:03.937914 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8e32d1d0-d3c9-41cd-bd66-f996f34c49a5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:03.944903 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e32d1d0-d3c9-41cd-bd66-f996f34c49a5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:03.945418 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e32d1d0-d3c9-41cd-bd66-f996f34c49a5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:03.945856 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e32d1d0-d3c9-41cd-bd66-f996f34c49a5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:03.946549 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e32d1d0-d3c9-41cd-bd66-f996f34c49a5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:03.947008 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e32d1d0-d3c9-41cd-bd66-f996f34c49a5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:03.947434 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8e32d1d0-d3c9-41cd-bd66-f996f34c49a5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:04.080332 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-8e32d1d0-d3c9-41cd-bd66-f996f34c49a5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:04.089969 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-8e32d1d0-d3c9-41cd-bd66-f996f34c49a5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:04.091428 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-8e32d1d0-d3c9-41cd-bd66-f996f34c49a5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:04.092580 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8e32d1d0-d3c9-41cd-bd66-f996f34c49a5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1725 microversion: 2.20 time: 0.159093 Oct 01 04:25:04.093169 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 391/812] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:25:03 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:25:04.575559 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-777392fb-d377-4211-8803-5b76d586e7f0 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:04.576180 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-777392fb-d377-4211-8803-5b76d586e7f0 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:04.582500 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-777392fb-d377-4211-8803-5b76d586e7f0 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:04.582996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-777392fb-d377-4211-8803-5b76d586e7f0 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:04.583694 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-777392fb-d377-4211-8803-5b76d586e7f0 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:04.584312 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-777392fb-d377-4211-8803-5b76d586e7f0 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:04.584614 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-777392fb-d377-4211-8803-5b76d586e7f0 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:04.585072 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-777392fb-d377-4211-8803-5b76d586e7f0 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:04.737979 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-777392fb-d377-4211-8803-5b76d586e7f0 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:04.745937 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-777392fb-d377-4211-8803-5b76d586e7f0 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1260 microversion: 2.1 time: 0.174156 Oct 01 04:25:04.746504 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 422/813] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:04 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:05.120535 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-730c5988-d535-4f07-b507-d20b124566f9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:05.121219 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-730c5988-d535-4f07-b507-d20b124566f9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:05.127681 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-730c5988-d535-4f07-b507-d20b124566f9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:05.128284 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-730c5988-d535-4f07-b507-d20b124566f9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:05.129080 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-730c5988-d535-4f07-b507-d20b124566f9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:05.130077 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-730c5988-d535-4f07-b507-d20b124566f9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:05.131473 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-730c5988-d535-4f07-b507-d20b124566f9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:05.132125 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-730c5988-d535-4f07-b507-d20b124566f9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:05.269805 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-730c5988-d535-4f07-b507-d20b124566f9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:05.280421 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-730c5988-d535-4f07-b507-d20b124566f9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:05.281879 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-730c5988-d535-4f07-b507-d20b124566f9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:05.283075 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-730c5988-d535-4f07-b507-d20b124566f9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1725 microversion: 2.20 time: 0.168029 Oct 01 04:25:05.283628 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 392/814] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:25:05 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:25:05.770327 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6f1c6ff5-7acb-4b75-a1fd-8b9eb0a6618b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:05.772339 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6f1c6ff5-7acb-4b75-a1fd-8b9eb0a6618b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:05.779775 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f1c6ff5-7acb-4b75-a1fd-8b9eb0a6618b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:05.780370 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f1c6ff5-7acb-4b75-a1fd-8b9eb0a6618b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:05.781174 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f1c6ff5-7acb-4b75-a1fd-8b9eb0a6618b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:05.782036 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f1c6ff5-7acb-4b75-a1fd-8b9eb0a6618b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:05.783133 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f1c6ff5-7acb-4b75-a1fd-8b9eb0a6618b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:05.783905 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6f1c6ff5-7acb-4b75-a1fd-8b9eb0a6618b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:05.811454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-c68d8917-0e14-49f4-8f6f-3ff001cb8e44 req-bb9d136b-be95-41e4-8229-3849b06e536e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b21e7357-43a2-4dc9-b0f6-26b14b68c464", "name": "network-vif-deleted", "tag": "735577aa-5ec2-48d4-8f41-38cb8f95250a"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:25:05.823690 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c68d8917-0e14-49f4-8f6f-3ff001cb8e44 req-bb9d136b-be95-41e4-8229-3849b06e536e service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:05.823690 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c68d8917-0e14-49f4-8f6f-3ff001cb8e44 req-bb9d136b-be95-41e4-8229-3849b06e536e service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:05.823690 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c68d8917-0e14-49f4-8f6f-3ff001cb8e44 req-bb9d136b-be95-41e4-8229-3849b06e536e service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:05.868408 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-c68d8917-0e14-49f4-8f6f-3ff001cb8e44 req-bb9d136b-be95-41e4-8229-3849b06e536e service nova] Creating event network-vif-deleted:735577aa-5ec2-48d4-8f41-38cb8f95250a for instance b21e7357-43a2-4dc9-b0f6-26b14b68c464 on hv-cinder-86004 Oct 01 04:25:05.886026 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-c68d8917-0e14-49f4-8f6f-3ff001cb8e44 req-bb9d136b-be95-41e4-8229-3849b06e536e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079324 Oct 01 04:25:05.886918 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 393/815] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:25:06.311028 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-be4b2658-ca2b-47c4-b15b-cbe2ccadbad9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:06.313300 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-be4b2658-ca2b-47c4-b15b-cbe2ccadbad9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:06.327461 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be4b2658-ca2b-47c4-b15b-cbe2ccadbad9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:06.327986 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be4b2658-ca2b-47c4-b15b-cbe2ccadbad9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:06.328756 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be4b2658-ca2b-47c4-b15b-cbe2ccadbad9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:06.329685 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be4b2658-ca2b-47c4-b15b-cbe2ccadbad9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:06.331282 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be4b2658-ca2b-47c4-b15b-cbe2ccadbad9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:06.331892 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be4b2658-ca2b-47c4-b15b-cbe2ccadbad9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:06.360748 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-6f1c6ff5-7acb-4b75-a1fd-8b9eb0a6618b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:06.370802 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6f1c6ff5-7acb-4b75-a1fd-8b9eb0a6618b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1444 microversion: 2.1 time: 0.605154 Oct 01 04:25:06.372232 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 423/816] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:05 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1444 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:06.412340 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bd56d8b5-04fb-4537-a37e-663056b4cbac tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:06.413670 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bd56d8b5-04fb-4537-a37e-663056b4cbac tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:06.420083 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd56d8b5-04fb-4537-a37e-663056b4cbac tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:06.420827 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd56d8b5-04fb-4537-a37e-663056b4cbac tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:06.421384 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd56d8b5-04fb-4537-a37e-663056b4cbac tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:06.422276 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd56d8b5-04fb-4537-a37e-663056b4cbac tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:06.422895 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd56d8b5-04fb-4537-a37e-663056b4cbac tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:06.423481 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bd56d8b5-04fb-4537-a37e-663056b4cbac tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:06.429615 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be4b2658-ca2b-47c4-b15b-cbe2ccadbad9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:06.430044 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be4b2658-ca2b-47c4-b15b-cbe2ccadbad9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:06.430826 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-be4b2658-ca2b-47c4-b15b-cbe2ccadbad9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:06.431559 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-be4b2658-ca2b-47c4-b15b-cbe2ccadbad9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lazy-loading 'fault' on Instance uuid b21e7357-43a2-4dc9-b0f6-26b14b68c464 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:25:06.501331 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-be4b2658-ca2b-47c4-b15b-cbe2ccadbad9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:06.525356 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-be4b2658-ca2b-47c4-b15b-cbe2ccadbad9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:06.527035 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-be4b2658-ca2b-47c4-b15b-cbe2ccadbad9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ccd631925a0a4f5ca8be5d3915778487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d87f6d9adf4ce98e934187ec8ae0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:06.528388 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-be4b2658-ca2b-47c4-b15b-cbe2ccadbad9 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 200 len: 1372 microversion: 2.20 time: 0.223636 Oct 01 04:25:06.529242 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 394/817] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:25:06 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 1372 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 01 04:25:06.606130 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-bd56d8b5-04fb-4537-a37e-663056b4cbac tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:06.616801 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bd56d8b5-04fb-4537-a37e-663056b4cbac tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1444 microversion: 2.1 time: 0.223965 Oct 01 04:25:06.617547 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 424/818] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:06 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1444 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:25:07.554361 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-154c76a6-d4fa-45b9-a991-d8656a3f73a5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:07.554972 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-154c76a6-d4fa-45b9-a991-d8656a3f73a5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:07.561621 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-154c76a6-d4fa-45b9-a991-d8656a3f73a5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:07.562351 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-154c76a6-d4fa-45b9-a991-d8656a3f73a5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:07.562932 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-154c76a6-d4fa-45b9-a991-d8656a3f73a5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:07.563638 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-154c76a6-d4fa-45b9-a991-d8656a3f73a5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:07.564267 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-154c76a6-d4fa-45b9-a991-d8656a3f73a5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:07.564696 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-154c76a6-d4fa-45b9-a991-d8656a3f73a5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:07.582173 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-154c76a6-d4fa-45b9-a991-d8656a3f73a5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] HTTP exception thrown: Instance b21e7357-43a2-4dc9-b0f6-26b14b68c464 could not be found. Oct 01 04:25:07.585374 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-154c76a6-d4fa-45b9-a991-d8656a3f73a5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Request method failure captured: Oct 01 04:25:07.585374 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 HTTP/1.1 Oct 01 04:25:07.585374 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept: application/json Oct 01 04:25:07.585374 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept-Encoding: identity Oct 01 04:25:07.585374 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Connection: close Oct 01 04:25:07.585374 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Length: 0 Oct 01 04:25:07.585374 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Type: application/json Oct 01 04:25:07.585374 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Host: 10.222.0.26 Oct 01 04:25:07.585374 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 01 04:25:07.585374 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 01 04:25:07.585374 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjN795k9lom01fxGasAf7dSFhEWKXNxA30ntET0DRM7p76a-qiBZjhY00TAAXxmtMK0Zho6OdoZHdd3uuDw_LfHZjzKVGmiYxUUKYRH8YNvYwho1fOjxLAH0AbPKI5uJGWu39VRVIbh0ABAVTZdGSxEl07LhSox3pjzydDV3DB0ft1smI Oct 01 04:25:07.585374 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Id: None Oct 01 04:25:07.585374 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Name: None Oct 01 04:25:07.585374 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 01 04:25:07.585374 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 01 04:25:07.585374 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Openstack-Nova-Api-Version: 2.20 Oct 01 04:25:07.585374 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 01 04:25:07.585374 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 01 04:25:07.585374 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Id: 19d87f6d9adf4ce98e934187ec8ae0d7 Oct 01 04:25:07.585374 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1941075162 Oct 01 04:25:07.585374 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Role: reader,member Oct 01 04:25:07.585374 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Roles: reader,member Oct 01 04:25:07.586877 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_19d87f6d9adf4ce98e934187ec8ae0d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/19d87f6d9adf4ce98e934187ec8ae0d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/19d87f6d9adf4ce98e934187ec8ae0d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/19d87f6d9adf4ce98e934187ec8ae0d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:25:07.586877 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1941075162 Oct 01 04:25:07.586877 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Id: 19d87f6d9adf4ce98e934187ec8ae0d7 Oct 01 04:25:07.586877 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1941075162 Oct 01 04:25:07.586877 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User: tempest-AttachVolumeShelveTestJSON-1941075162-project Oct 01 04:25:07.586877 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 01 04:25:07.586877 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 01 04:25:07.586877 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Id: ccd631925a0a4f5ca8be5d3915778487 Oct 01 04:25:07.586877 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1941075162-project Oct 01 04:25:07.586877 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: method: > Oct 01 04:25:07.586877 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: exception: Instance b21e7357-43a2-4dc9-b0f6-26b14b68c464 could not be found. Oct 01 04:25:07.586877 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: action_args: {'id': 'b21e7357-43a2-4dc9-b0f6-26b14b68c464'} Oct 01 04:25:07.587672 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:25:07.587672 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:25:07.587672 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:25:07.587672 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:25:07.587672 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:25:07.587672 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:25:07.587672 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:25:07.587672 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:25:07.587672 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:25:07.587672 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:25:07.587672 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b21e7357-43a2-4dc9-b0f6-26b14b68c464 could not be found. Oct 01 04:25:07.587672 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:25:07.587672 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:25:07.587672 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:25:07.587672 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:25:07.587672 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:25:07.587672 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:25:07.587672 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:25:07.587672 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:25:07.587672 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:25:07.590399 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:25:07.590399 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:25:07.590399 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:25:07.590399 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:25:07.590399 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:25:07.590399 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:25:07.590399 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:25:07.590399 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b21e7357-43a2-4dc9-b0f6-26b14b68c464 could not be found. Oct 01 04:25:07.590399 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:25:07.590399 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:25:07.590399 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:25:07.590399 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:25:07.590399 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:25:07.590399 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:25:07.590399 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:25:07.590399 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:25:07.590399 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b21e7357-43a2-4dc9-b0f6-26b14b68c464 could not be found. Oct 01 04:25:07.590399 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:25:07.592315 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-154c76a6-d4fa-45b9-a991-d8656a3f73a5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Returning 404 to user: Instance b21e7357-43a2-4dc9-b0f6-26b14b68c464 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:25:07.592315 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-154c76a6-d4fa-45b9-a991-d8656a3f73a5 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 404 len: 111 microversion: 2.20 time: 0.036383 Oct 01 04:25:07.592315 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 395/819] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:25:07 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 04:25:07.599353 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-311e9ae0-a000-4aea-bc33-1a418349ffed tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '.version_select at 0x7fdfbe625f70>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:07.622156 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-311e9ae0-a000-4aea-bc33-1a418349ffed tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1959557846" status: 204 len: 0 microversion: 2.20 time: 0.027415 Oct 01 04:25:07.622779 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 425/820] 10.222.0.26 () {60 vars in 1262 bytes} [Sat Oct 1 04:25:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1959557846 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 01 04:25:09.054944 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-994606c4-7f1e-4e56-9b14-1ab58a5bd6d8 req-526cc4d9-3bac-4470-b317-042cf58ae721 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2af93c94-483f-4f6d-a017-d45ef01bac8d", "tag": "ff800efd-217a-4aea-84a5-e5f05dd17b62"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:25:09.064620 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-994606c4-7f1e-4e56-9b14-1ab58a5bd6d8 req-526cc4d9-3bac-4470-b317-042cf58ae721 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:09.065137 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-994606c4-7f1e-4e56-9b14-1ab58a5bd6d8 req-526cc4d9-3bac-4470-b317-042cf58ae721 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:09.065590 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-994606c4-7f1e-4e56-9b14-1ab58a5bd6d8 req-526cc4d9-3bac-4470-b317-042cf58ae721 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:09.079159 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-994606c4-7f1e-4e56-9b14-1ab58a5bd6d8 req-526cc4d9-3bac-4470-b317-042cf58ae721 service nova] Creating event network-changed:ff800efd-217a-4aea-84a5-e5f05dd17b62 for instance 2af93c94-483f-4f6d-a017-d45ef01bac8d on hv-cinder-86004 Oct 01 04:25:09.085168 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-994606c4-7f1e-4e56-9b14-1ab58a5bd6d8 req-526cc4d9-3bac-4470-b317-042cf58ae721 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176609 Oct 01 04:25:09.085755 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 396/821] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:25:09.829129 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f40e0d6d-f0d8-4161-bbe8-e1c4aa32c371 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:09.830148 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f40e0d6d-f0d8-4161-bbe8-e1c4aa32c371 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:09.849724 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f40e0d6d-f0d8-4161-bbe8-e1c4aa32c371 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:09.850259 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f40e0d6d-f0d8-4161-bbe8-e1c4aa32c371 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:09.850705 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f40e0d6d-f0d8-4161-bbe8-e1c4aa32c371 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:09.851589 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f40e0d6d-f0d8-4161-bbe8-e1c4aa32c371 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:09.852048 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f40e0d6d-f0d8-4161-bbe8-e1c4aa32c371 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:09.852476 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f40e0d6d-f0d8-4161-bbe8-e1c4aa32c371 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:09.874928 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-f40e0d6d-f0d8-4161-bbe8-e1c4aa32c371 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] HTTP exception thrown: Instance b21e7357-43a2-4dc9-b0f6-26b14b68c464 could not be found. Oct 01 04:25:09.877044 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f40e0d6d-f0d8-4161-bbe8-e1c4aa32c371 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Request method failure captured: Oct 01 04:25:09.877044 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 HTTP/1.1 Oct 01 04:25:09.877044 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:25:09.877044 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:25:09.877044 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:25:09.877044 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 0 Oct 01 04:25:09.877044 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:25:09.877044 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:25:09.877044 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:25:09.877044 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:25:09.877044 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN795k9lom01fxGasAf7dSFhEWKXNxA30ntET0DRM7p76a-qiBZjhY00TAAXxmtMK0Zho6OdoZHdd3uuDw_LfHZjzKVGmiYxUUKYRH8YNvYwho1fOjxLAH0AbPKI5uJGWu39VRVIbh0ABAVTZdGSxEl07LhSox3pjzydDV3DB0ft1smI Oct 01 04:25:09.877044 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:25:09.877044 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:25:09.877044 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:25:09.877044 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:25:09.877044 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Openstack-Nova-Api-Version: 2.20 Oct 01 04:25:09.877044 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:25:09.877044 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:25:09.877044 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: 19d87f6d9adf4ce98e934187ec8ae0d7 Oct 01 04:25:09.877044 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1941075162 Oct 01 04:25:09.877044 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:25:09.877044 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:25:09.878953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_19d87f6d9adf4ce98e934187ec8ae0d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/19d87f6d9adf4ce98e934187ec8ae0d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/19d87f6d9adf4ce98e934187ec8ae0d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/19d87f6d9adf4ce98e934187ec8ae0d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:25:09.878953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1941075162 Oct 01 04:25:09.878953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 19d87f6d9adf4ce98e934187ec8ae0d7 Oct 01 04:25:09.878953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1941075162 Oct 01 04:25:09.878953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-AttachVolumeShelveTestJSON-1941075162-project Oct 01 04:25:09.878953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:25:09.878953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:25:09.878953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: ccd631925a0a4f5ca8be5d3915778487 Oct 01 04:25:09.878953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1941075162-project Oct 01 04:25:09.878953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: > Oct 01 04:25:09.878953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Instance b21e7357-43a2-4dc9-b0f6-26b14b68c464 could not be found. Oct 01 04:25:09.878953 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'id': 'b21e7357-43a2-4dc9-b0f6-26b14b68c464'} Oct 01 04:25:09.880563 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:25:09.880563 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:25:09.880563 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:25:09.880563 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:25:09.880563 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:25:09.880563 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:25:09.880563 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:25:09.880563 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:25:09.880563 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:25:09.880563 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:25:09.880563 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b21e7357-43a2-4dc9-b0f6-26b14b68c464 could not be found. Oct 01 04:25:09.880563 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:25:09.880563 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:25:09.880563 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:25:09.880563 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:25:09.880563 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:25:09.880563 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:25:09.880563 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:25:09.880563 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:25:09.880563 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:25:09.882561 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:25:09.882561 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 04:25:09.882561 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 04:25:09.882561 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 04:25:09.882561 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 04:25:09.882561 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:25:09.882561 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:25:09.882561 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:25:09.882561 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:25:09.882561 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b21e7357-43a2-4dc9-b0f6-26b14b68c464 could not be found. Oct 01 04:25:09.882561 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:25:09.882561 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:25:09.882561 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:25:09.882561 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:25:09.882561 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:25:09.882561 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:25:09.882561 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:25:09.882561 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:25:09.882561 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b21e7357-43a2-4dc9-b0f6-26b14b68c464 could not be found. Oct 01 04:25:09.882561 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:25:09.884019 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f40e0d6d-f0d8-4161-bbe8-e1c4aa32c371 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Returning 404 to user: Instance b21e7357-43a2-4dc9-b0f6-26b14b68c464 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:25:09.884019 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f40e0d6d-f0d8-4161-bbe8-e1c4aa32c371 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 404 len: 111 microversion: 2.20 time: 0.053243 Oct 01 04:25:09.884019 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 426/822] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 1 04:25:09 2022] DELETE /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 04:25:09.890197 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1a052c71-581a-4e14-9cde-d4e9d4eeccf7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:09.891307 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1a052c71-581a-4e14-9cde-d4e9d4eeccf7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: b21e7357-43a2-4dc9-b0f6-26b14b68c464] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:09.894234 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:25:09.905550 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a052c71-581a-4e14-9cde-d4e9d4eeccf7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:09.906059 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a052c71-581a-4e14-9cde-d4e9d4eeccf7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:09.906536 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a052c71-581a-4e14-9cde-d4e9d4eeccf7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:09.907257 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a052c71-581a-4e14-9cde-d4e9d4eeccf7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:09.907735 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a052c71-581a-4e14-9cde-d4e9d4eeccf7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:09.908165 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1a052c71-581a-4e14-9cde-d4e9d4eeccf7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:09.924273 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-1a052c71-581a-4e14-9cde-d4e9d4eeccf7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] HTTP exception thrown: Instance b21e7357-43a2-4dc9-b0f6-26b14b68c464 could not be found. Oct 01 04:25:09.925977 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1a052c71-581a-4e14-9cde-d4e9d4eeccf7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Request method failure captured: Oct 01 04:25:09.925977 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 HTTP/1.1 Oct 01 04:25:09.925977 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept: application/json Oct 01 04:25:09.925977 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept-Encoding: identity Oct 01 04:25:09.925977 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Connection: close Oct 01 04:25:09.925977 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Length: 0 Oct 01 04:25:09.925977 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Type: application/json Oct 01 04:25:09.925977 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Host: 10.222.0.26 Oct 01 04:25:09.925977 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 01 04:25:09.925977 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 01 04:25:09.925977 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjN795k9lom01fxGasAf7dSFhEWKXNxA30ntET0DRM7p76a-qiBZjhY00TAAXxmtMK0Zho6OdoZHdd3uuDw_LfHZjzKVGmiYxUUKYRH8YNvYwho1fOjxLAH0AbPKI5uJGWu39VRVIbh0ABAVTZdGSxEl07LhSox3pjzydDV3DB0ft1smI Oct 01 04:25:09.925977 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Id: None Oct 01 04:25:09.925977 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Name: None Oct 01 04:25:09.925977 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 01 04:25:09.925977 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 01 04:25:09.925977 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Openstack-Nova-Api-Version: 2.20 Oct 01 04:25:09.925977 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 01 04:25:09.925977 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 01 04:25:09.925977 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Id: 19d87f6d9adf4ce98e934187ec8ae0d7 Oct 01 04:25:09.925977 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1941075162 Oct 01 04:25:09.925977 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Role: reader,member Oct 01 04:25:09.925977 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Roles: reader,member Oct 01 04:25:09.928433 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_19d87f6d9adf4ce98e934187ec8ae0d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/19d87f6d9adf4ce98e934187ec8ae0d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/19d87f6d9adf4ce98e934187ec8ae0d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/19d87f6d9adf4ce98e934187ec8ae0d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:25:09.928433 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1941075162 Oct 01 04:25:09.928433 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Id: 19d87f6d9adf4ce98e934187ec8ae0d7 Oct 01 04:25:09.928433 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1941075162 Oct 01 04:25:09.928433 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User: tempest-AttachVolumeShelveTestJSON-1941075162-project Oct 01 04:25:09.928433 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 01 04:25:09.928433 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 01 04:25:09.928433 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Id: ccd631925a0a4f5ca8be5d3915778487 Oct 01 04:25:09.928433 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1941075162-project Oct 01 04:25:09.928433 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: method: > Oct 01 04:25:09.928433 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: exception: Instance b21e7357-43a2-4dc9-b0f6-26b14b68c464 could not be found. Oct 01 04:25:09.928433 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: action_args: {'id': 'b21e7357-43a2-4dc9-b0f6-26b14b68c464'} Oct 01 04:25:09.929388 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:25:09.929388 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:25:09.929388 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:25:09.929388 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:25:09.929388 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:25:09.929388 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:25:09.929388 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:25:09.929388 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:25:09.929388 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:25:09.929388 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:25:09.929388 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b21e7357-43a2-4dc9-b0f6-26b14b68c464 could not be found. Oct 01 04:25:09.929388 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:25:09.929388 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:25:09.929388 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:25:09.929388 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:25:09.929388 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:25:09.929388 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:25:09.929388 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:25:09.929388 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:25:09.929388 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:25:09.930852 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:25:09.930852 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:25:09.930852 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:25:09.930852 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:25:09.930852 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:25:09.930852 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:25:09.930852 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:25:09.930852 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b21e7357-43a2-4dc9-b0f6-26b14b68c464 could not be found. Oct 01 04:25:09.930852 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:25:09.930852 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:25:09.930852 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:25:09.930852 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:25:09.930852 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:25:09.930852 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:25:09.930852 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:25:09.930852 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:25:09.930852 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b21e7357-43a2-4dc9-b0f6-26b14b68c464 could not be found. Oct 01 04:25:09.930852 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:25:09.933315 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1a052c71-581a-4e14-9cde-d4e9d4eeccf7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Returning 404 to user: Instance b21e7357-43a2-4dc9-b0f6-26b14b68c464 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:25:09.934350 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1a052c71-581a-4e14-9cde-d4e9d4eeccf7 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464" status: 404 len: 111 microversion: 2.20 time: 0.048917 Oct 01 04:25:09.935103 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 397/823] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:25:09 2022] GET /compute/v2.1/servers/b21e7357-43a2-4dc9-b0f6-26b14b68c464 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 04:25:11.103742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-03e38010-dfa6-4e1a-be13-7226ca51a565 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:11.104378 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-03e38010-dfa6-4e1a-be13-7226ca51a565 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:11.110923 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03e38010-dfa6-4e1a-be13-7226ca51a565 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:11.111403 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03e38010-dfa6-4e1a-be13-7226ca51a565 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:11.111833 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03e38010-dfa6-4e1a-be13-7226ca51a565 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:11.112539 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03e38010-dfa6-4e1a-be13-7226ca51a565 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:11.113015 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03e38010-dfa6-4e1a-be13-7226ca51a565 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:11.113435 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-03e38010-dfa6-4e1a-be13-7226ca51a565 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:11.126463 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-03e38010-dfa6-4e1a-be13-7226ca51a565 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] HTTP exception thrown: Instance e14e3570-67e7-43d6-bcaf-6688168956b2 could not be found. Oct 01 04:25:11.127912 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-03e38010-dfa6-4e1a-be13-7226ca51a565 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Request method failure captured: Oct 01 04:25:11.127912 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 HTTP/1.1 Oct 01 04:25:11.127912 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:25:11.127912 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:25:11.127912 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:25:11.127912 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 0 Oct 01 04:25:11.127912 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:25:11.127912 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:25:11.127912 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:25:11.127912 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:25:11.127912 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN795k9lom01fxGasAf7dSFhEWKXNxA30ntET0DRM7p76a-qiBZjhY00TAAXxmtMK0Zho6OdoZHdd3uuDw_LfHZjzKVGmiYxUUKYRH8YNvYwho1fOjxLAH0AbPKI5uJGWu39VRVIbh0ABAVTZdGSxEl07LhSox3pjzydDV3DB0ft1smI Oct 01 04:25:11.127912 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:25:11.127912 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:25:11.127912 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:25:11.127912 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:25:11.127912 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Openstack-Nova-Api-Version: 2.20 Oct 01 04:25:11.127912 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:25:11.127912 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:25:11.127912 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: 19d87f6d9adf4ce98e934187ec8ae0d7 Oct 01 04:25:11.127912 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1941075162 Oct 01 04:25:11.127912 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:25:11.127912 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:25:11.129577 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_19d87f6d9adf4ce98e934187ec8ae0d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/19d87f6d9adf4ce98e934187ec8ae0d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/19d87f6d9adf4ce98e934187ec8ae0d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/19d87f6d9adf4ce98e934187ec8ae0d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:25:11.129577 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1941075162 Oct 01 04:25:11.129577 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 19d87f6d9adf4ce98e934187ec8ae0d7 Oct 01 04:25:11.129577 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1941075162 Oct 01 04:25:11.129577 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-AttachVolumeShelveTestJSON-1941075162-project Oct 01 04:25:11.129577 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:25:11.129577 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:25:11.129577 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: ccd631925a0a4f5ca8be5d3915778487 Oct 01 04:25:11.129577 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1941075162-project Oct 01 04:25:11.129577 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: > Oct 01 04:25:11.129577 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Instance e14e3570-67e7-43d6-bcaf-6688168956b2 could not be found. Oct 01 04:25:11.129577 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'id': 'e14e3570-67e7-43d6-bcaf-6688168956b2'} Oct 01 04:25:11.130864 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:25:11.130864 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:25:11.130864 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:25:11.130864 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:25:11.130864 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:25:11.130864 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:25:11.130864 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:25:11.130864 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:25:11.130864 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:25:11.130864 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:25:11.130864 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e14e3570-67e7-43d6-bcaf-6688168956b2 could not be found. Oct 01 04:25:11.130864 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:25:11.130864 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:25:11.130864 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:25:11.130864 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:25:11.130864 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:25:11.130864 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:25:11.130864 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:25:11.130864 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:25:11.130864 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:25:11.132391 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:25:11.132391 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 04:25:11.132391 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 04:25:11.132391 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 04:25:11.132391 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 04:25:11.132391 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:25:11.132391 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:25:11.132391 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:25:11.132391 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:25:11.132391 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e14e3570-67e7-43d6-bcaf-6688168956b2 could not be found. Oct 01 04:25:11.132391 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:25:11.132391 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:25:11.132391 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:25:11.132391 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:25:11.132391 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:25:11.132391 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:25:11.132391 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:25:11.132391 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:25:11.132391 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e14e3570-67e7-43d6-bcaf-6688168956b2 could not be found. Oct 01 04:25:11.132391 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:25:11.133956 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-03e38010-dfa6-4e1a-be13-7226ca51a565 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Returning 404 to user: Instance e14e3570-67e7-43d6-bcaf-6688168956b2 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:25:11.133956 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-03e38010-dfa6-4e1a-be13-7226ca51a565 tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 404 len: 111 microversion: 2.20 time: 0.031415 Oct 01 04:25:11.133956 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 427/824] 10.222.0.26 () {60 vars in 1280 bytes} [Sat Oct 1 04:25:11 2022] DELETE /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 01 04:25:11.137865 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eba4fd14-16c1-4281-bcf7-7c779005f6ce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:11.138508 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-eba4fd14-16c1-4281-bcf7-7c779005f6ce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] [instance: e14e3570-67e7-43d6-bcaf-6688168956b2] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:11.146313 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eba4fd14-16c1-4281-bcf7-7c779005f6ce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:11.146927 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eba4fd14-16c1-4281-bcf7-7c779005f6ce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:11.147149 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eba4fd14-16c1-4281-bcf7-7c779005f6ce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:11.147837 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eba4fd14-16c1-4281-bcf7-7c779005f6ce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:11.148294 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eba4fd14-16c1-4281-bcf7-7c779005f6ce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:11.148719 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-eba4fd14-16c1-4281-bcf7-7c779005f6ce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:11.163439 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-eba4fd14-16c1-4281-bcf7-7c779005f6ce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] HTTP exception thrown: Instance e14e3570-67e7-43d6-bcaf-6688168956b2 could not be found. Oct 01 04:25:11.165099 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eba4fd14-16c1-4281-bcf7-7c779005f6ce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Request method failure captured: Oct 01 04:25:11.165099 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 HTTP/1.1 Oct 01 04:25:11.165099 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept: application/json Oct 01 04:25:11.165099 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept-Encoding: identity Oct 01 04:25:11.165099 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Connection: close Oct 01 04:25:11.165099 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Length: 0 Oct 01 04:25:11.165099 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Type: application/json Oct 01 04:25:11.165099 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Host: 10.222.0.26 Oct 01 04:25:11.165099 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 01 04:25:11.165099 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 01 04:25:11.165099 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjN795k9lom01fxGasAf7dSFhEWKXNxA30ntET0DRM7p76a-qiBZjhY00TAAXxmtMK0Zho6OdoZHdd3uuDw_LfHZjzKVGmiYxUUKYRH8YNvYwho1fOjxLAH0AbPKI5uJGWu39VRVIbh0ABAVTZdGSxEl07LhSox3pjzydDV3DB0ft1smI Oct 01 04:25:11.165099 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Id: None Oct 01 04:25:11.165099 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Name: None Oct 01 04:25:11.165099 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 01 04:25:11.165099 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 01 04:25:11.165099 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Openstack-Nova-Api-Version: 2.20 Oct 01 04:25:11.165099 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 01 04:25:11.165099 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 01 04:25:11.165099 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Id: 19d87f6d9adf4ce98e934187ec8ae0d7 Oct 01 04:25:11.165099 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1941075162 Oct 01 04:25:11.165099 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Role: reader,member Oct 01 04:25:11.165099 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Roles: reader,member Oct 01 04:25:11.166793 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_19d87f6d9adf4ce98e934187ec8ae0d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/19d87f6d9adf4ce98e934187ec8ae0d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/19d87f6d9adf4ce98e934187ec8ae0d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/19d87f6d9adf4ce98e934187ec8ae0d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:25:11.166793 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1941075162 Oct 01 04:25:11.166793 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Id: 19d87f6d9adf4ce98e934187ec8ae0d7 Oct 01 04:25:11.166793 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1941075162 Oct 01 04:25:11.166793 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User: tempest-AttachVolumeShelveTestJSON-1941075162-project Oct 01 04:25:11.166793 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 01 04:25:11.166793 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 01 04:25:11.166793 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Id: ccd631925a0a4f5ca8be5d3915778487 Oct 01 04:25:11.166793 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1941075162-project Oct 01 04:25:11.166793 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: method: > Oct 01 04:25:11.166793 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: exception: Instance e14e3570-67e7-43d6-bcaf-6688168956b2 could not be found. Oct 01 04:25:11.166793 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: action_args: {'id': 'e14e3570-67e7-43d6-bcaf-6688168956b2'} Oct 01 04:25:11.167715 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:25:11.167715 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:25:11.167715 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:25:11.167715 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:25:11.167715 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:25:11.167715 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:25:11.167715 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:25:11.167715 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:25:11.167715 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:25:11.167715 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:25:11.167715 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e14e3570-67e7-43d6-bcaf-6688168956b2 could not be found. Oct 01 04:25:11.167715 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:25:11.167715 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:25:11.167715 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:25:11.167715 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:25:11.167715 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:25:11.167715 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:25:11.167715 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:25:11.167715 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:25:11.167715 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:25:11.169323 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:25:11.169323 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:25:11.169323 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:25:11.169323 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:25:11.169323 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:25:11.169323 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:25:11.169323 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:25:11.169323 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e14e3570-67e7-43d6-bcaf-6688168956b2 could not be found. Oct 01 04:25:11.169323 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:25:11.169323 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:25:11.169323 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:25:11.169323 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:25:11.169323 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:25:11.169323 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:25:11.169323 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:25:11.169323 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:25:11.169323 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e14e3570-67e7-43d6-bcaf-6688168956b2 could not be found. Oct 01 04:25:11.169323 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:25:11.170753 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-eba4fd14-16c1-4281-bcf7-7c779005f6ce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] Returning 404 to user: Instance e14e3570-67e7-43d6-bcaf-6688168956b2 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:25:11.170753 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-eba4fd14-16c1-4281-bcf7-7c779005f6ce tempest-AttachVolumeShelveTestJSON-1941075162 tempest-AttachVolumeShelveTestJSON-1941075162-project] 10.222.0.26 "GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2" status: 404 len: 111 microversion: 2.20 time: 0.032596 Oct 01 04:25:11.170753 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 398/825] 10.222.0.26 () {60 vars in 1277 bytes} [Sat Oct 1 04:25:11 2022] GET /compute/v2.1/servers/e14e3570-67e7-43d6-bcaf-6688168956b2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 01 04:25:12.052512 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7a9b4284-c9ab-415a-a56b-bb18c2d1572d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1114326330", "imageRef": "c63d52d7-4e3d-40cf-a8b5-59a2d027d793", "flavorRef": "452"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:25:12.112041 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-7a9b4284-c9ab-415a-a56b-bb18c2d1572d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] validate_networks() for None {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 04:25:12.439030 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-7a9b4284-c9ab-415a-a56b-bb18c2d1572d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 04:25:12.439456 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-7a9b4284-c9ab-415a-a56b-bb18c2d1572d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 04:25:12.439936 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-7a9b4284-c9ab-415a-a56b-bb18c2d1572d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 04:25:12.440346 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-7a9b4284-c9ab-415a-a56b-bb18c2d1572d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 04:25:12.440764 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-7a9b4284-c9ab-415a-a56b-bb18c2d1572d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 04:25:12.449941 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a9b4284-c9ab-415a-a56b-bb18c2d1572d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:12.450430 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a9b4284-c9ab-415a-a56b-bb18c2d1572d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:12.450870 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a9b4284-c9ab-415a-a56b-bb18c2d1572d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:12.451602 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a9b4284-c9ab-415a-a56b-bb18c2d1572d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:12.452062 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a9b4284-c9ab-415a-a56b-bb18c2d1572d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:12.452490 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a9b4284-c9ab-415a-a56b-bb18c2d1572d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:12.470418 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-7a9b4284-c9ab-415a-a56b-bb18c2d1572d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Getting quotas for project a1c1e492262e44cab94a51e215413e61. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:25:12.475008 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-7a9b4284-c9ab-415a-a56b-bb18c2d1572d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Getting quotas for user 9358a5806ca7428eaa75670d137b18eb and project a1c1e492262e44cab94a51e215413e61. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:25:12.485956 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7a9b4284-c9ab-415a-a56b-bb18c2d1572d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 04:25:12.488286 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7a9b4284-c9ab-415a-a56b-bb18c2d1572d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] [instance: b6565067-94e1-498c-bed5-584d383158aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c63d52d7-4e3d-40cf-a8b5-59a2d027d793',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 04:25:12.534088 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7a9b4284-c9ab-415a-a56b-bb18c2d1572d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.486451 Oct 01 04:25:12.541600 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 428/826] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 1 04:25:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 04:25:12.547220 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3aacd1ec-026a-4907-a65a-be5f06b5ec71 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:12.547871 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3aacd1ec-026a-4907-a65a-be5f06b5ec71 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] [instance: b6565067-94e1-498c-bed5-584d383158aa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:12.618829 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-3aacd1ec-026a-4907-a65a-be5f06b5ec71 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9358a5806ca7428eaa75670d137b18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c1e492262e44cab94a51e215413e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:12.626133 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3aacd1ec-026a-4907-a65a-be5f06b5ec71 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] 10.222.0.26 "GET /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa" status: 200 len: 1215 microversion: 2.1 time: 0.082753 Oct 01 04:25:12.626853 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 399/827] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:12 2022] GET /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:13.652209 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f6782861-c0b1-49f3-9006-18294f73f82d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:13.652837 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f6782861-c0b1-49f3-9006-18294f73f82d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] [instance: b6565067-94e1-498c-bed5-584d383158aa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:13.659490 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6782861-c0b1-49f3-9006-18294f73f82d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:13.659990 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6782861-c0b1-49f3-9006-18294f73f82d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:13.660432 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6782861-c0b1-49f3-9006-18294f73f82d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:13.661316 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6782861-c0b1-49f3-9006-18294f73f82d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:13.662631 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6782861-c0b1-49f3-9006-18294f73f82d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:13.663085 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f6782861-c0b1-49f3-9006-18294f73f82d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:13.752356 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f6782861-c0b1-49f3-9006-18294f73f82d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9358a5806ca7428eaa75670d137b18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c1e492262e44cab94a51e215413e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:13.769240 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f6782861-c0b1-49f3-9006-18294f73f82d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] 10.222.0.26 "GET /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa" status: 200 len: 1275 microversion: 2.1 time: 0.122016 Oct 01 04:25:13.773901 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 429/828] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:13 2022] GET /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa => generated 1275 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:14.798933 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e528a599-2b5c-423f-bf52-bbb0ff6c2339 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:14.799897 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e528a599-2b5c-423f-bf52-bbb0ff6c2339 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] [instance: b6565067-94e1-498c-bed5-584d383158aa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:14.815597 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e528a599-2b5c-423f-bf52-bbb0ff6c2339 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:14.816117 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e528a599-2b5c-423f-bf52-bbb0ff6c2339 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:14.818074 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e528a599-2b5c-423f-bf52-bbb0ff6c2339 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:14.819250 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e528a599-2b5c-423f-bf52-bbb0ff6c2339 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:14.819849 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e528a599-2b5c-423f-bf52-bbb0ff6c2339 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:14.820451 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e528a599-2b5c-423f-bf52-bbb0ff6c2339 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:15.057897 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-e528a599-2b5c-423f-bf52-bbb0ff6c2339 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9358a5806ca7428eaa75670d137b18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c1e492262e44cab94a51e215413e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:15.069514 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e528a599-2b5c-423f-bf52-bbb0ff6c2339 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] 10.222.0.26 "GET /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa" status: 200 len: 1315 microversion: 2.1 time: 0.275933 Oct 01 04:25:15.071057 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 400/829] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:14 2022] GET /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:15.824508 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-0d8b9fb6-f025-4468-a79c-4ea0fa7b3534 req-7cff05d2-62d8-45b6-87fd-7622ce3f8081 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6565067-94e1-498c-bed5-584d383158aa", "tag": "ed6c94aa-e359-4da3-af91-03cfd00c5d3c"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:25:15.838494 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0d8b9fb6-f025-4468-a79c-4ea0fa7b3534 req-7cff05d2-62d8-45b6-87fd-7622ce3f8081 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:15.839115 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0d8b9fb6-f025-4468-a79c-4ea0fa7b3534 req-7cff05d2-62d8-45b6-87fd-7622ce3f8081 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:15.839813 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-0d8b9fb6-f025-4468-a79c-4ea0fa7b3534 req-7cff05d2-62d8-45b6-87fd-7622ce3f8081 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:15.852830 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-0d8b9fb6-f025-4468-a79c-4ea0fa7b3534 req-7cff05d2-62d8-45b6-87fd-7622ce3f8081 service nova] Creating event network-changed:ed6c94aa-e359-4da3-af91-03cfd00c5d3c for instance b6565067-94e1-498c-bed5-584d383158aa on hv-cinder-86004 Oct 01 04:25:15.858632 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-0d8b9fb6-f025-4468-a79c-4ea0fa7b3534 req-7cff05d2-62d8-45b6-87fd-7622ce3f8081 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039551 Oct 01 04:25:15.859639 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 430/830] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:25:16.094677 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1207875d-0362-4b29-9f8c-bf942487e7ea tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:16.095579 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1207875d-0362-4b29-9f8c-bf942487e7ea tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] [instance: b6565067-94e1-498c-bed5-584d383158aa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:16.106118 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1207875d-0362-4b29-9f8c-bf942487e7ea tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:16.106731 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1207875d-0362-4b29-9f8c-bf942487e7ea tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:16.107275 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1207875d-0362-4b29-9f8c-bf942487e7ea tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:16.108234 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1207875d-0362-4b29-9f8c-bf942487e7ea tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:16.108862 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1207875d-0362-4b29-9f8c-bf942487e7ea tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:16.109556 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1207875d-0362-4b29-9f8c-bf942487e7ea tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:16.365401 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-1207875d-0362-4b29-9f8c-bf942487e7ea tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9358a5806ca7428eaa75670d137b18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c1e492262e44cab94a51e215413e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:16.373531 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1207875d-0362-4b29-9f8c-bf942487e7ea tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] 10.222.0.26 "GET /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa" status: 200 len: 1315 microversion: 2.1 time: 0.282769 Oct 01 04:25:16.374105 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 401/831] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:16 2022] GET /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:17.399212 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d4077cf8-0e3f-43ec-86c6-084f101b1d1e tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:17.400742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d4077cf8-0e3f-43ec-86c6-084f101b1d1e tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] [instance: b6565067-94e1-498c-bed5-584d383158aa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:17.407536 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4077cf8-0e3f-43ec-86c6-084f101b1d1e tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:17.408381 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4077cf8-0e3f-43ec-86c6-084f101b1d1e tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:17.409163 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4077cf8-0e3f-43ec-86c6-084f101b1d1e tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:17.410182 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4077cf8-0e3f-43ec-86c6-084f101b1d1e tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:17.411027 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4077cf8-0e3f-43ec-86c6-084f101b1d1e tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:17.412020 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d4077cf8-0e3f-43ec-86c6-084f101b1d1e tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:17.663321 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d4077cf8-0e3f-43ec-86c6-084f101b1d1e tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9358a5806ca7428eaa75670d137b18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c1e492262e44cab94a51e215413e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:17.672592 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d4077cf8-0e3f-43ec-86c6-084f101b1d1e tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] 10.222.0.26 "GET /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa" status: 200 len: 1315 microversion: 2.1 time: 0.279835 Oct 01 04:25:17.673376 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 431/832] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:17 2022] GET /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:18.696796 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-583c1ec8-adc2-418f-81f3-11f0fdbbd7ac tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:18.697577 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-583c1ec8-adc2-418f-81f3-11f0fdbbd7ac tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] [instance: b6565067-94e1-498c-bed5-584d383158aa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:18.704410 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-583c1ec8-adc2-418f-81f3-11f0fdbbd7ac tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:18.705186 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-583c1ec8-adc2-418f-81f3-11f0fdbbd7ac tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:18.705629 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-583c1ec8-adc2-418f-81f3-11f0fdbbd7ac tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:18.706336 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-583c1ec8-adc2-418f-81f3-11f0fdbbd7ac tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:18.706802 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-583c1ec8-adc2-418f-81f3-11f0fdbbd7ac tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:18.707368 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-583c1ec8-adc2-418f-81f3-11f0fdbbd7ac tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:18.712269 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=99 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:25:18.860750 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-583c1ec8-adc2-418f-81f3-11f0fdbbd7ac tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9358a5806ca7428eaa75670d137b18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c1e492262e44cab94a51e215413e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:18.869157 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-583c1ec8-adc2-418f-81f3-11f0fdbbd7ac tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] 10.222.0.26 "GET /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa" status: 200 len: 1315 microversion: 2.1 time: 0.177309 Oct 01 04:25:18.870116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 402/833] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:18 2022] GET /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:19.899081 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a91c26f7-c9d4-4339-8f03-5ce869623972 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:19.900429 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a91c26f7-c9d4-4339-8f03-5ce869623972 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] [instance: b6565067-94e1-498c-bed5-584d383158aa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:19.904036 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:25:19.914825 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a91c26f7-c9d4-4339-8f03-5ce869623972 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:19.915807 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a91c26f7-c9d4-4339-8f03-5ce869623972 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:19.916446 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a91c26f7-c9d4-4339-8f03-5ce869623972 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:19.917452 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a91c26f7-c9d4-4339-8f03-5ce869623972 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:19.918086 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a91c26f7-c9d4-4339-8f03-5ce869623972 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:19.918674 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a91c26f7-c9d4-4339-8f03-5ce869623972 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:19.928426 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:25:20.092202 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a91c26f7-c9d4-4339-8f03-5ce869623972 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9358a5806ca7428eaa75670d137b18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c1e492262e44cab94a51e215413e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:20.101218 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a91c26f7-c9d4-4339-8f03-5ce869623972 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] 10.222.0.26 "GET /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa" status: 200 len: 1315 microversion: 2.1 time: 0.210817 Oct 01 04:25:20.114782 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 432/834] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:19 2022] GET /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:20.290926 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b4cff494-7a66-4313-9184-0a5d91d2c40a tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Action: 'create', calling method: .version_select at 0x7fdfbe690160>, body: {"keypair": {"name": "tempest-keypair-1867061793", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOiUIsYk/Rqf7G0f58+N0Bci5eRHM2OZQBsndjryIxGghJZoW1tE64yD1Se9sfOs5W976eUK8c6Jj6M1k/z9WvCPIwMptqnR5gC2LNSJVZGnnGbV2lzwE1sydYnduoR6WQ=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:25:20.307205 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-b4cff494-7a66-4313-9184-0a5d91d2c40a tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Getting quotas for project 57f927e7829a4172b9919b964a9e7c13. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:25:20.312322 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-b4cff494-7a66-4313-9184-0a5d91d2c40a tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Getting quotas for user 0e30d69a25494d70bc094eb92c4f9bb0 and project 57f927e7829a4172b9919b964a9e7c13. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:25:20.337083 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b4cff494-7a66-4313-9184-0a5d91d2c40a tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.173143 Oct 01 04:25:20.337704 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 403/835] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 1 04:25:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:25:20.983356 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-eab39367-f90f-4a11-b34b-f9d0d4763811 req-84121f18-990c-4a7f-984d-deb19a4d6d05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6565067-94e1-498c-bed5-584d383158aa", "name": "network-vif-plugged", "status": "completed", "tag": "ed6c94aa-e359-4da3-af91-03cfd00c5d3c"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:25:20.997189 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-eab39367-f90f-4a11-b34b-f9d0d4763811 req-84121f18-990c-4a7f-984d-deb19a4d6d05 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:20.997957 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-eab39367-f90f-4a11-b34b-f9d0d4763811 req-84121f18-990c-4a7f-984d-deb19a4d6d05 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:20.998393 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-eab39367-f90f-4a11-b34b-f9d0d4763811 req-84121f18-990c-4a7f-984d-deb19a4d6d05 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:21.012626 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-eab39367-f90f-4a11-b34b-f9d0d4763811 req-84121f18-990c-4a7f-984d-deb19a4d6d05 service nova] Creating event network-vif-plugged:ed6c94aa-e359-4da3-af91-03cfd00c5d3c for instance b6565067-94e1-498c-bed5-584d383158aa on hv-cinder-86004 Oct 01 04:25:21.018858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-eab39367-f90f-4a11-b34b-f9d0d4763811 req-84121f18-990c-4a7f-984d-deb19a4d6d05 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040485 Oct 01 04:25:21.020633 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 433/836] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:25:21.131148 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b2f1fe15-8fde-4d11-b244-298015285c9e tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:21.131773 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b2f1fe15-8fde-4d11-b244-298015285c9e tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] [instance: b6565067-94e1-498c-bed5-584d383158aa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:21.181575 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2f1fe15-8fde-4d11-b244-298015285c9e tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:21.182251 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2f1fe15-8fde-4d11-b244-298015285c9e tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:21.182954 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2f1fe15-8fde-4d11-b244-298015285c9e tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:21.183715 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2f1fe15-8fde-4d11-b244-298015285c9e tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:21.184183 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2f1fe15-8fde-4d11-b244-298015285c9e tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:21.184614 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b2f1fe15-8fde-4d11-b244-298015285c9e tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:21.434666 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-b2f1fe15-8fde-4d11-b244-298015285c9e tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9358a5806ca7428eaa75670d137b18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c1e492262e44cab94a51e215413e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:21.445285 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b2f1fe15-8fde-4d11-b244-298015285c9e tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] 10.222.0.26 "GET /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa" status: 200 len: 1315 microversion: 2.1 time: 0.323309 Oct 01 04:25:21.446241 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 404/837] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:21 2022] GET /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:22.060171 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d7283f04-1e30-42a3-9563-4a60d50069e3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-567153096", "imageRef": "c63d52d7-4e3d-40cf-a8b5-59a2d027d793", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bddd7754-f392-4f22-b92b-c088917d60a6"}], "security_groups": [{"name": "tempest-securitygroup--1230326552"}], "key_name": "tempest-keypair-1867061793", "user_data": "}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:25:22.173564 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-d7283f04-1e30-42a3-9563-4a60d50069e3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] validate_networks() for [('bddd7754-f392-4f22-b92b-c088917d60a6', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 04:25:22.461725 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:25:22.476095 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-71e4701a-bd9d-4469-a058-36fdac8f68c5 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:22.476717 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-71e4701a-bd9d-4469-a058-36fdac8f68c5 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] [instance: b6565067-94e1-498c-bed5-584d383158aa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:22.483671 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:25:22.488107 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71e4701a-bd9d-4469-a058-36fdac8f68c5 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:22.488604 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71e4701a-bd9d-4469-a058-36fdac8f68c5 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:22.489497 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71e4701a-bd9d-4469-a058-36fdac8f68c5 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:22.490500 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71e4701a-bd9d-4469-a058-36fdac8f68c5 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:22.491274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71e4701a-bd9d-4469-a058-36fdac8f68c5 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:22.491860 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-71e4701a-bd9d-4469-a058-36fdac8f68c5 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:22.629378 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d7283f04-1e30-42a3-9563-4a60d50069e3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 04:25:22.630412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d7283f04-1e30-42a3-9563-4a60d50069e3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 04:25:22.630990 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d7283f04-1e30-42a3-9563-4a60d50069e3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 04:25:22.631498 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d7283f04-1e30-42a3-9563-4a60d50069e3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 04:25:22.632005 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d7283f04-1e30-42a3-9563-4a60d50069e3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 04:25:22.643548 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7283f04-1e30-42a3-9563-4a60d50069e3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:22.644376 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7283f04-1e30-42a3-9563-4a60d50069e3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:22.645925 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7283f04-1e30-42a3-9563-4a60d50069e3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:22.646767 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7283f04-1e30-42a3-9563-4a60d50069e3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:22.647298 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7283f04-1e30-42a3-9563-4a60d50069e3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:22.647796 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d7283f04-1e30-42a3-9563-4a60d50069e3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:22.668017 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-71e4701a-bd9d-4469-a058-36fdac8f68c5 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9358a5806ca7428eaa75670d137b18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c1e492262e44cab94a51e215413e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:22.672090 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-d7283f04-1e30-42a3-9563-4a60d50069e3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Getting quotas for project 57f927e7829a4172b9919b964a9e7c13. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:25:22.675920 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-71e4701a-bd9d-4469-a058-36fdac8f68c5 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] 10.222.0.26 "GET /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa" status: 200 len: 1315 microversion: 2.1 time: 0.209694 Oct 01 04:25:22.676445 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-d7283f04-1e30-42a3-9563-4a60d50069e3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Getting quotas for user 0e30d69a25494d70bc094eb92c4f9bb0 and project 57f927e7829a4172b9919b964a9e7c13. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:25:22.688969 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 405/838] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:22 2022] GET /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:22.689179 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d7283f04-1e30-42a3-9563-4a60d50069e3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 04:25:22.690399 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d7283f04-1e30-42a3-9563-4a60d50069e3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 7666cbd6-6648-4f0b-ba58-7a95bd94700c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c63d52d7-4e3d-40cf-a8b5-59a2d027d793',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 04:25:22.739138 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d7283f04-1e30-42a3-9563-4a60d50069e3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.684071 Oct 01 04:25:22.739765 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 434/839] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 1 04:25:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 04:25:22.750658 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c45456e4-9cbc-4b11-aca7-b76736c23dad tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:22.751275 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c45456e4-9cbc-4b11-aca7-b76736c23dad tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 7666cbd6-6648-4f0b-ba58-7a95bd94700c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:22.807536 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c45456e4-9cbc-4b11-aca7-b76736c23dad tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:22.817527 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c45456e4-9cbc-4b11-aca7-b76736c23dad tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c" status: 200 len: 1241 microversion: 2.1 time: 0.070022 Oct 01 04:25:22.819066 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 406/840] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:22 2022] GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:23.699646 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d9a43c48-628c-4f12-8633-b6b2705c3cf6 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:23.700350 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d9a43c48-628c-4f12-8633-b6b2705c3cf6 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] [instance: b6565067-94e1-498c-bed5-584d383158aa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:23.707215 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9a43c48-628c-4f12-8633-b6b2705c3cf6 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:23.707884 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9a43c48-628c-4f12-8633-b6b2705c3cf6 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:23.708326 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9a43c48-628c-4f12-8633-b6b2705c3cf6 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:23.709039 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9a43c48-628c-4f12-8633-b6b2705c3cf6 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:23.709498 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9a43c48-628c-4f12-8633-b6b2705c3cf6 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:23.709918 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d9a43c48-628c-4f12-8633-b6b2705c3cf6 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:23.842982 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3b6a964f-0449-4554-8f35-d9aa115e8561 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:23.844047 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3b6a964f-0449-4554-8f35-d9aa115e8561 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 7666cbd6-6648-4f0b-ba58-7a95bd94700c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:23.854006 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d9a43c48-628c-4f12-8633-b6b2705c3cf6 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9358a5806ca7428eaa75670d137b18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c1e492262e44cab94a51e215413e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:23.864408 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d9a43c48-628c-4f12-8633-b6b2705c3cf6 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] 10.222.0.26 "GET /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa" status: 200 len: 1464 microversion: 2.1 time: 0.168501 Oct 01 04:25:23.882583 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 435/841] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:23 2022] GET /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa => generated 1464 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:23.941454 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-244f0c21-cbc9-40d4-a1df-9c6e54fdd4c4 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:23.942602 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-244f0c21-cbc9-40d4-a1df-9c6e54fdd4c4 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] [instance: b6565067-94e1-498c-bed5-584d383158aa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:23.961204 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-244f0c21-cbc9-40d4-a1df-9c6e54fdd4c4 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:23.961993 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-244f0c21-cbc9-40d4-a1df-9c6e54fdd4c4 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:23.962687 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-244f0c21-cbc9-40d4-a1df-9c6e54fdd4c4 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:23.963655 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-244f0c21-cbc9-40d4-a1df-9c6e54fdd4c4 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:23.964578 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-244f0c21-cbc9-40d4-a1df-9c6e54fdd4c4 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:23.965197 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-244f0c21-cbc9-40d4-a1df-9c6e54fdd4c4 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:23.999792 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-244f0c21-cbc9-40d4-a1df-9c6e54fdd4c4 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] [instance: b6565067-94e1-498c-bed5-584d383158aa] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 04:25:24.046005 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b6a964f-0449-4554-8f35-d9aa115e8561 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:24.046743 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b6a964f-0449-4554-8f35-d9aa115e8561 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:24.047240 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b6a964f-0449-4554-8f35-d9aa115e8561 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:24.048045 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b6a964f-0449-4554-8f35-d9aa115e8561 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:24.048870 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b6a964f-0449-4554-8f35-d9aa115e8561 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:24.049407 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3b6a964f-0449-4554-8f35-d9aa115e8561 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:24.112021 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-244f0c21-cbc9-40d4-a1df-9c6e54fdd4c4 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa" status: 204 len: 0 microversion: 2.1 time: 0.173389 Oct 01 04:25:24.113448 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 436/842] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 1 04:25:23 2022] DELETE /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 04:25:24.126493 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9c99f9d9-ab6f-418a-9ff6-606555364e3b tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:24.127312 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9c99f9d9-ab6f-418a-9ff6-606555364e3b tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] [instance: b6565067-94e1-498c-bed5-584d383158aa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:24.139229 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-3b6a964f-0449-4554-8f35-d9aa115e8561 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:24.146968 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c99f9d9-ab6f-418a-9ff6-606555364e3b tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:24.147490 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c99f9d9-ab6f-418a-9ff6-606555364e3b tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:24.147924 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c99f9d9-ab6f-418a-9ff6-606555364e3b tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:24.148645 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c99f9d9-ab6f-418a-9ff6-606555364e3b tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:24.149169 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c99f9d9-ab6f-418a-9ff6-606555364e3b tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:24.149600 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c99f9d9-ab6f-418a-9ff6-606555364e3b tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:24.152822 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3b6a964f-0449-4554-8f35-d9aa115e8561 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c" status: 200 len: 1311 microversion: 2.1 time: 0.313547 Oct 01 04:25:24.157730 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 407/843] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:23 2022] GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c => generated 1311 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:24.309283 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-9c99f9d9-ab6f-418a-9ff6-606555364e3b tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9358a5806ca7428eaa75670d137b18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c1e492262e44cab94a51e215413e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:24.317988 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9c99f9d9-ab6f-418a-9ff6-606555364e3b tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] 10.222.0.26 "GET /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa" status: 200 len: 1470 microversion: 2.1 time: 0.194814 Oct 01 04:25:24.318756 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 437/844] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:24 2022] GET /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa => generated 1470 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:25.179875 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c9bf557d-bb14-4e05-a8b0-56fca3abba5f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:25.180482 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c9bf557d-bb14-4e05-a8b0-56fca3abba5f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 7666cbd6-6648-4f0b-ba58-7a95bd94700c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:25.186856 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9bf557d-bb14-4e05-a8b0-56fca3abba5f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:25.187336 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9bf557d-bb14-4e05-a8b0-56fca3abba5f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:25.187771 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9bf557d-bb14-4e05-a8b0-56fca3abba5f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:25.188453 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9bf557d-bb14-4e05-a8b0-56fca3abba5f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:25.188910 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9bf557d-bb14-4e05-a8b0-56fca3abba5f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:25.189357 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c9bf557d-bb14-4e05-a8b0-56fca3abba5f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:25.253327 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c9bf557d-bb14-4e05-a8b0-56fca3abba5f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:25.261368 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c9bf557d-bb14-4e05-a8b0-56fca3abba5f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c" status: 200 len: 1299 microversion: 2.1 time: 0.085622 Oct 01 04:25:25.261918 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 408/845] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:25 2022] GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c => generated 1299 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:25.342241 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-38f17235-d730-4433-bf09-314f8b54332d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:25.343563 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-38f17235-d730-4433-bf09-314f8b54332d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] [instance: b6565067-94e1-498c-bed5-584d383158aa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:25.351746 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38f17235-d730-4433-bf09-314f8b54332d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:25.352256 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38f17235-d730-4433-bf09-314f8b54332d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:25.352757 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38f17235-d730-4433-bf09-314f8b54332d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:25.353970 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38f17235-d730-4433-bf09-314f8b54332d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:25.354971 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38f17235-d730-4433-bf09-314f8b54332d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:25.355401 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-38f17235-d730-4433-bf09-314f8b54332d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:25.486021 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-38f17235-d730-4433-bf09-314f8b54332d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9358a5806ca7428eaa75670d137b18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c1e492262e44cab94a51e215413e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:25.493737 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-38f17235-d730-4433-bf09-314f8b54332d tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] 10.222.0.26 "GET /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa" status: 200 len: 1470 microversion: 2.1 time: 0.155833 Oct 01 04:25:25.494314 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 438/846] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:25 2022] GET /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:26.285092 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6131fcbf-7f10-455b-bb20-3e1db805ed07 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:26.287251 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6131fcbf-7f10-455b-bb20-3e1db805ed07 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 7666cbd6-6648-4f0b-ba58-7a95bd94700c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:26.294019 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6131fcbf-7f10-455b-bb20-3e1db805ed07 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:26.294510 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6131fcbf-7f10-455b-bb20-3e1db805ed07 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:26.295114 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6131fcbf-7f10-455b-bb20-3e1db805ed07 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:26.295991 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6131fcbf-7f10-455b-bb20-3e1db805ed07 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:26.296628 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6131fcbf-7f10-455b-bb20-3e1db805ed07 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:26.297282 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6131fcbf-7f10-455b-bb20-3e1db805ed07 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:26.363460 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-6131fcbf-7f10-455b-bb20-3e1db805ed07 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:26.372292 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6131fcbf-7f10-455b-bb20-3e1db805ed07 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c" status: 200 len: 1299 microversion: 2.1 time: 0.090962 Oct 01 04:25:26.372860 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 409/847] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:26 2022] GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:26.522622 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c121507f-59a9-4441-8d86-154f0cacd724 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:26.523317 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c121507f-59a9-4441-8d86-154f0cacd724 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] [instance: b6565067-94e1-498c-bed5-584d383158aa] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:26.530004 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c121507f-59a9-4441-8d86-154f0cacd724 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:26.530494 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c121507f-59a9-4441-8d86-154f0cacd724 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:26.530926 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c121507f-59a9-4441-8d86-154f0cacd724 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:26.531630 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c121507f-59a9-4441-8d86-154f0cacd724 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:26.532085 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c121507f-59a9-4441-8d86-154f0cacd724 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:26.532504 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c121507f-59a9-4441-8d86-154f0cacd724 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:26.702926 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c121507f-59a9-4441-8d86-154f0cacd724 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9358a5806ca7428eaa75670d137b18eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c1e492262e44cab94a51e215413e61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:26.714487 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c121507f-59a9-4441-8d86-154f0cacd724 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] 10.222.0.26 "GET /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa" status: 200 len: 1470 microversion: 2.1 time: 0.202364 Oct 01 04:25:26.715907 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 439/848] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:26 2022] GET /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa => generated 1470 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:26.760413 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-50129e51-f63e-4064-8f59-f412e2b0b474 req-2c19d2d2-9b78-4eed-a783-faec3164fca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6565067-94e1-498c-bed5-584d383158aa", "name": "network-vif-deleted", "tag": "ed6c94aa-e359-4da3-af91-03cfd00c5d3c"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:25:26.775023 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-50129e51-f63e-4064-8f59-f412e2b0b474 req-2c19d2d2-9b78-4eed-a783-faec3164fca1 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:26.775777 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-50129e51-f63e-4064-8f59-f412e2b0b474 req-2c19d2d2-9b78-4eed-a783-faec3164fca1 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:26.776395 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-50129e51-f63e-4064-8f59-f412e2b0b474 req-2c19d2d2-9b78-4eed-a783-faec3164fca1 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:26.793617 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-50129e51-f63e-4064-8f59-f412e2b0b474 req-2c19d2d2-9b78-4eed-a783-faec3164fca1 service nova] Creating event network-vif-deleted:ed6c94aa-e359-4da3-af91-03cfd00c5d3c for instance b6565067-94e1-498c-bed5-584d383158aa on hv-cinder-86004 Oct 01 04:25:26.804543 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-50129e51-f63e-4064-8f59-f412e2b0b474 req-2c19d2d2-9b78-4eed-a783-faec3164fca1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050633 Oct 01 04:25:26.807439 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 410/849] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:25:27.395921 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9ec8ca17-7de1-463c-9d01-a3a98ff8dcb2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:27.396540 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9ec8ca17-7de1-463c-9d01-a3a98ff8dcb2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 7666cbd6-6648-4f0b-ba58-7a95bd94700c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:27.402466 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ec8ca17-7de1-463c-9d01-a3a98ff8dcb2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:27.403017 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ec8ca17-7de1-463c-9d01-a3a98ff8dcb2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:27.403534 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ec8ca17-7de1-463c-9d01-a3a98ff8dcb2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:27.404340 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ec8ca17-7de1-463c-9d01-a3a98ff8dcb2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:27.405973 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ec8ca17-7de1-463c-9d01-a3a98ff8dcb2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:27.406620 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9ec8ca17-7de1-463c-9d01-a3a98ff8dcb2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:27.543768 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-9ec8ca17-7de1-463c-9d01-a3a98ff8dcb2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:27.552231 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9ec8ca17-7de1-463c-9d01-a3a98ff8dcb2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c" status: 200 len: 1367 microversion: 2.1 time: 0.160858 Oct 01 04:25:27.552937 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 440/850] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:27 2022] GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:27.739956 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4ebe39a6-6241-4af2-91d3-29bcb313cce2 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:27.740748 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4ebe39a6-6241-4af2-91d3-29bcb313cce2 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] [instance: b6565067-94e1-498c-bed5-584d383158aa] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:27.746985 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ebe39a6-6241-4af2-91d3-29bcb313cce2 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:27.747477 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ebe39a6-6241-4af2-91d3-29bcb313cce2 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:27.747917 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ebe39a6-6241-4af2-91d3-29bcb313cce2 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:27.748619 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ebe39a6-6241-4af2-91d3-29bcb313cce2 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:27.749111 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ebe39a6-6241-4af2-91d3-29bcb313cce2 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:27.749547 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4ebe39a6-6241-4af2-91d3-29bcb313cce2 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:27.763133 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-4ebe39a6-6241-4af2-91d3-29bcb313cce2 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] HTTP exception thrown: Instance b6565067-94e1-498c-bed5-584d383158aa could not be found. Oct 01 04:25:27.764811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4ebe39a6-6241-4af2-91d3-29bcb313cce2 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Request method failure captured: Oct 01 04:25:27.764811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa HTTP/1.1 Oct 01 04:25:27.764811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept: application/json Oct 01 04:25:27.764811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept-Encoding: identity Oct 01 04:25:27.764811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Connection: close Oct 01 04:25:27.764811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Length: 0 Oct 01 04:25:27.764811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Type: application/json Oct 01 04:25:27.764811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Host: 10.222.0.26 Oct 01 04:25:27.764811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 01 04:25:27.764811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 01 04:25:27.764811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjN8EmFqeaHsgD7OwmO-JRtGRTKipSyDBU2OHqqOxq4ft6BQG2i15uO2W1vIfJ8FqGC-MNF4M8kPTiupccgsqG-0qraBR9GGfrK3op6-znVbfJKswFMneQEgVun1ZbLXHHqkzr75QbL32OUjSwr2YvYaa5VVboEJDUsndItHCabfP0ZZ8 Oct 01 04:25:27.764811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Id: None Oct 01 04:25:27.764811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Name: None Oct 01 04:25:27.764811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 01 04:25:27.764811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 01 04:25:27.764811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 01 04:25:27.764811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 01 04:25:27.764811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Id: a1c1e492262e44cab94a51e215413e61 Oct 01 04:25:27.764811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Name: tempest-VolumesNegativeTest-1723188056 Oct 01 04:25:27.764811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Role: reader,member Oct 01 04:25:27.764811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Roles: reader,member Oct 01 04:25:27.766396 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a1c1e492262e44cab94a51e215413e61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a1c1e492262e44cab94a51e215413e61"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a1c1e492262e44cab94a51e215413e61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a1c1e492262e44cab94a51e215413e61"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:25:27.766396 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant: tempest-VolumesNegativeTest-1723188056 Oct 01 04:25:27.766396 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Id: a1c1e492262e44cab94a51e215413e61 Oct 01 04:25:27.766396 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Name: tempest-VolumesNegativeTest-1723188056 Oct 01 04:25:27.766396 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User: tempest-VolumesNegativeTest-1723188056-project Oct 01 04:25:27.766396 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 01 04:25:27.766396 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 01 04:25:27.766396 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Id: 9358a5806ca7428eaa75670d137b18eb Oct 01 04:25:27.766396 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Name: tempest-VolumesNegativeTest-1723188056-project Oct 01 04:25:27.766396 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: method: > Oct 01 04:25:27.766396 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: exception: Instance b6565067-94e1-498c-bed5-584d383158aa could not be found. Oct 01 04:25:27.766396 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: action_args: {'id': 'b6565067-94e1-498c-bed5-584d383158aa'} Oct 01 04:25:27.767441 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:25:27.767441 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:25:27.767441 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:25:27.767441 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:25:27.767441 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:25:27.767441 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:25:27.767441 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:25:27.767441 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:25:27.767441 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:25:27.767441 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:25:27.767441 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6565067-94e1-498c-bed5-584d383158aa could not be found. Oct 01 04:25:27.767441 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:25:27.767441 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:25:27.767441 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:25:27.767441 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:25:27.767441 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:25:27.767441 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:25:27.767441 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:25:27.767441 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:25:27.767441 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:25:27.769101 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:25:27.769101 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:25:27.769101 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:25:27.769101 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:25:27.769101 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:25:27.769101 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:25:27.769101 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:25:27.769101 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6565067-94e1-498c-bed5-584d383158aa could not be found. Oct 01 04:25:27.769101 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:25:27.769101 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:25:27.769101 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:25:27.769101 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:25:27.769101 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:25:27.769101 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:25:27.769101 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:25:27.769101 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:25:27.769101 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6565067-94e1-498c-bed5-584d383158aa could not be found. Oct 01 04:25:27.769101 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:25:27.771171 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4ebe39a6-6241-4af2-91d3-29bcb313cce2 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] Returning 404 to user: Instance b6565067-94e1-498c-bed5-584d383158aa could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:25:27.771171 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4ebe39a6-6241-4af2-91d3-29bcb313cce2 tempest-VolumesNegativeTest-1723188056 tempest-VolumesNegativeTest-1723188056-project] 10.222.0.26 "GET /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa" status: 404 len: 111 microversion: 2.1 time: 0.031036 Oct 01 04:25:27.771171 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 411/851] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:27 2022] GET /compute/v2.1/servers/b6565067-94e1-498c-bed5-584d383158aa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:25:28.575234 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-79aae519-36a6-4e53-8d6f-cb07ec80f5e6 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:28.575793 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-79aae519-36a6-4e53-8d6f-cb07ec80f5e6 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 7666cbd6-6648-4f0b-ba58-7a95bd94700c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:28.582227 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79aae519-36a6-4e53-8d6f-cb07ec80f5e6 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:28.583126 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79aae519-36a6-4e53-8d6f-cb07ec80f5e6 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:28.583465 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79aae519-36a6-4e53-8d6f-cb07ec80f5e6 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:28.584355 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79aae519-36a6-4e53-8d6f-cb07ec80f5e6 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:28.584813 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79aae519-36a6-4e53-8d6f-cb07ec80f5e6 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:28.585264 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-79aae519-36a6-4e53-8d6f-cb07ec80f5e6 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:28.727258 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-79aae519-36a6-4e53-8d6f-cb07ec80f5e6 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:28.735188 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-79aae519-36a6-4e53-8d6f-cb07ec80f5e6 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c" status: 200 len: 1367 microversion: 2.1 time: 0.163754 Oct 01 04:25:28.735761 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 441/852] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:28 2022] GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:28.822623 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-6100a281-573d-46cd-a3f4-f71c8afce65b req-a677db0c-94d3-413f-ab92-1559cb787803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7666cbd6-6648-4f0b-ba58-7a95bd94700c", "tag": "6050285d-4ac5-4514-991a-d2765dc0ca76"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:25:28.832616 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-6100a281-573d-46cd-a3f4-f71c8afce65b req-a677db0c-94d3-413f-ab92-1559cb787803 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:28.833100 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-6100a281-573d-46cd-a3f4-f71c8afce65b req-a677db0c-94d3-413f-ab92-1559cb787803 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:28.833519 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-6100a281-573d-46cd-a3f4-f71c8afce65b req-a677db0c-94d3-413f-ab92-1559cb787803 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:28.844245 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-6100a281-573d-46cd-a3f4-f71c8afce65b req-a677db0c-94d3-413f-ab92-1559cb787803 service nova] Creating event network-changed:6050285d-4ac5-4514-991a-d2765dc0ca76 for instance 7666cbd6-6648-4f0b-ba58-7a95bd94700c on hv-cinder-86004 Oct 01 04:25:28.850050 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-6100a281-573d-46cd-a3f4-f71c8afce65b req-a677db0c-94d3-413f-ab92-1559cb787803 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030897 Oct 01 04:25:28.850779 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 412/853] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:25:29.760020 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1dcc5c2a-7ad3-4e52-91ef-d3e7e563667e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:29.760715 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1dcc5c2a-7ad3-4e52-91ef-d3e7e563667e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 7666cbd6-6648-4f0b-ba58-7a95bd94700c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:29.767312 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dcc5c2a-7ad3-4e52-91ef-d3e7e563667e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:29.767871 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dcc5c2a-7ad3-4e52-91ef-d3e7e563667e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:29.768383 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dcc5c2a-7ad3-4e52-91ef-d3e7e563667e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:29.769283 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dcc5c2a-7ad3-4e52-91ef-d3e7e563667e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:29.770109 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dcc5c2a-7ad3-4e52-91ef-d3e7e563667e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:29.770609 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1dcc5c2a-7ad3-4e52-91ef-d3e7e563667e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:29.901685 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1dcc5c2a-7ad3-4e52-91ef-d3e7e563667e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:29.909562 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1dcc5c2a-7ad3-4e52-91ef-d3e7e563667e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c" status: 200 len: 1367 microversion: 2.1 time: 0.153446 Oct 01 04:25:29.910139 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 442/854] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:29 2022] GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:25:30.932779 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c2a76fbf-60bc-4ce2-9441-3729a38eabe5 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:30.933427 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c2a76fbf-60bc-4ce2-9441-3729a38eabe5 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 7666cbd6-6648-4f0b-ba58-7a95bd94700c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:30.940008 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2a76fbf-60bc-4ce2-9441-3729a38eabe5 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:30.940495 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2a76fbf-60bc-4ce2-9441-3729a38eabe5 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:30.940947 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2a76fbf-60bc-4ce2-9441-3729a38eabe5 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:30.941686 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2a76fbf-60bc-4ce2-9441-3729a38eabe5 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:30.942146 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2a76fbf-60bc-4ce2-9441-3729a38eabe5 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:30.942568 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c2a76fbf-60bc-4ce2-9441-3729a38eabe5 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:31.072756 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c2a76fbf-60bc-4ce2-9441-3729a38eabe5 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:31.080337 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c2a76fbf-60bc-4ce2-9441-3729a38eabe5 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c" status: 200 len: 1367 microversion: 2.1 time: 0.151785 Oct 01 04:25:31.080891 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 413/855] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:30 2022] GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:32.103545 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-252bc19d-2e2a-4314-91eb-04876b762454 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:32.104163 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-252bc19d-2e2a-4314-91eb-04876b762454 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 7666cbd6-6648-4f0b-ba58-7a95bd94700c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:32.110690 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-252bc19d-2e2a-4314-91eb-04876b762454 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:32.111180 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-252bc19d-2e2a-4314-91eb-04876b762454 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:32.111622 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-252bc19d-2e2a-4314-91eb-04876b762454 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:32.112304 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-252bc19d-2e2a-4314-91eb-04876b762454 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:32.112755 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-252bc19d-2e2a-4314-91eb-04876b762454 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:32.113198 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-252bc19d-2e2a-4314-91eb-04876b762454 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:32.257356 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-252bc19d-2e2a-4314-91eb-04876b762454 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:32.265442 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-252bc19d-2e2a-4314-91eb-04876b762454 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c" status: 200 len: 1367 microversion: 2.1 time: 0.165744 Oct 01 04:25:32.266029 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 443/856] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:32 2022] GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:32.494400 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-f4cea6b1-dcab-41af-811e-0337994771f8 req-cd7d19fb-4716-4729-88e9-588afeb946c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7666cbd6-6648-4f0b-ba58-7a95bd94700c", "name": "network-vif-plugged", "status": "completed", "tag": "6050285d-4ac5-4514-991a-d2765dc0ca76"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:25:32.504466 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f4cea6b1-dcab-41af-811e-0337994771f8 req-cd7d19fb-4716-4729-88e9-588afeb946c3 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:32.505569 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f4cea6b1-dcab-41af-811e-0337994771f8 req-cd7d19fb-4716-4729-88e9-588afeb946c3 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:32.506015 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f4cea6b1-dcab-41af-811e-0337994771f8 req-cd7d19fb-4716-4729-88e9-588afeb946c3 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:32.519829 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-f4cea6b1-dcab-41af-811e-0337994771f8 req-cd7d19fb-4716-4729-88e9-588afeb946c3 service nova] Creating event network-vif-plugged:6050285d-4ac5-4514-991a-d2765dc0ca76 for instance 7666cbd6-6648-4f0b-ba58-7a95bd94700c on hv-cinder-86004 Oct 01 04:25:32.525883 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-f4cea6b1-dcab-41af-811e-0337994771f8 req-cd7d19fb-4716-4729-88e9-588afeb946c3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035191 Oct 01 04:25:32.526663 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 414/857] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:25:33.289800 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-91e22711-41cc-487a-b48c-d14487ded9aa tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:33.290414 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-91e22711-41cc-487a-b48c-d14487ded9aa tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 7666cbd6-6648-4f0b-ba58-7a95bd94700c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:33.292398 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:25:33.293111 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:25:33.299363 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91e22711-41cc-487a-b48c-d14487ded9aa tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:33.299849 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91e22711-41cc-487a-b48c-d14487ded9aa tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:33.300287 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91e22711-41cc-487a-b48c-d14487ded9aa tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:33.301785 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91e22711-41cc-487a-b48c-d14487ded9aa tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:33.302329 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91e22711-41cc-487a-b48c-d14487ded9aa tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:33.302822 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-91e22711-41cc-487a-b48c-d14487ded9aa tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:33.436739 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-91e22711-41cc-487a-b48c-d14487ded9aa tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:33.444449 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-91e22711-41cc-487a-b48c-d14487ded9aa tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c" status: 200 len: 1367 microversion: 2.1 time: 0.159293 Oct 01 04:25:33.445033 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 444/858] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:33 2022] GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:34.465231 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=8 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:25:34.469849 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cb4c5857-bc98-47c6-bf52-a8314a448dbe tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:34.470549 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cb4c5857-bc98-47c6-bf52-a8314a448dbe tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 7666cbd6-6648-4f0b-ba58-7a95bd94700c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:34.477348 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb4c5857-bc98-47c6-bf52-a8314a448dbe tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:34.477850 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb4c5857-bc98-47c6-bf52-a8314a448dbe tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:34.478287 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb4c5857-bc98-47c6-bf52-a8314a448dbe tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:34.478980 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb4c5857-bc98-47c6-bf52-a8314a448dbe tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:34.479437 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb4c5857-bc98-47c6-bf52-a8314a448dbe tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:34.479863 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb4c5857-bc98-47c6-bf52-a8314a448dbe tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:34.609187 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-cb4c5857-bc98-47c6-bf52-a8314a448dbe tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:25:34.617462 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cb4c5857-bc98-47c6-bf52-a8314a448dbe tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c" status: 200 len: 1555 microversion: 2.1 time: 0.153193 Oct 01 04:25:34.618020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 415/859] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:25:34 2022] GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:25:34.639618 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-62bd83d5-51ee-48ac-92a1-d58dd6e6e4ca tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:25:34.640160 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-62bd83d5-51ee-48ac-92a1-d58dd6e6e4ca tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 7666cbd6-6648-4f0b-ba58-7a95bd94700c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:25:34.647357 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62bd83d5-51ee-48ac-92a1-d58dd6e6e4ca tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:34.647843 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62bd83d5-51ee-48ac-92a1-d58dd6e6e4ca tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:34.648282 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62bd83d5-51ee-48ac-92a1-d58dd6e6e4ca tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:34.648995 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62bd83d5-51ee-48ac-92a1-d58dd6e6e4ca tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:34.649459 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62bd83d5-51ee-48ac-92a1-d58dd6e6e4ca tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:34.649885 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-62bd83d5-51ee-48ac-92a1-d58dd6e6e4ca tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:34.726805 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-62bd83d5-51ee-48ac-92a1-d58dd6e6e4ca tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091030 Oct 01 04:25:34.727397 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 445/860] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 1 04:25:34 2022] GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:25:35.653368 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-0143b8bb-f378-4331-95cc-5215f758650c req-aa5a1f92-5675-4883-a698-1a5bb3639139 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7666cbd6-6648-4f0b-ba58-7a95bd94700c", "tag": "6050285d-4ac5-4514-991a-d2765dc0ca76"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:25:35.663431 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0143b8bb-f378-4331-95cc-5215f758650c req-aa5a1f92-5675-4883-a698-1a5bb3639139 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:25:35.663939 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0143b8bb-f378-4331-95cc-5215f758650c req-aa5a1f92-5675-4883-a698-1a5bb3639139 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:25:35.664365 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-0143b8bb-f378-4331-95cc-5215f758650c req-aa5a1f92-5675-4883-a698-1a5bb3639139 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:25:35.675311 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-0143b8bb-f378-4331-95cc-5215f758650c req-aa5a1f92-5675-4883-a698-1a5bb3639139 service nova] Creating event network-changed:6050285d-4ac5-4514-991a-d2765dc0ca76 for instance 7666cbd6-6648-4f0b-ba58-7a95bd94700c on hv-cinder-86004 Oct 01 04:25:35.681196 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-0143b8bb-f378-4331-95cc-5215f758650c req-aa5a1f92-5675-4883-a698-1a5bb3639139 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031220 Oct 01 04:25:35.682090 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 416/861] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:26:11.531832 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:26:11.532578 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:26:11.537399 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a311d50b-5519-42c4-8f1b-52dc5a79efa1 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:11.537890 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a311d50b-5519-42c4-8f1b-52dc5a79efa1 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 7666cbd6-6648-4f0b-ba58-7a95bd94700c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:11.545205 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a311d50b-5519-42c4-8f1b-52dc5a79efa1 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:11.545737 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a311d50b-5519-42c4-8f1b-52dc5a79efa1 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:11.546170 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a311d50b-5519-42c4-8f1b-52dc5a79efa1 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:11.546854 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a311d50b-5519-42c4-8f1b-52dc5a79efa1 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:11.547305 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a311d50b-5519-42c4-8f1b-52dc5a79efa1 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:11.547723 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a311d50b-5519-42c4-8f1b-52dc5a79efa1 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:11.572404 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a311d50b-5519-42c4-8f1b-52dc5a79efa1 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c/ips" status: 200 len: 148 microversion: 2.1 time: 0.042046 Oct 01 04:26:11.573099 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 446/862] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 1 04:26:11 2022] GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c/ips => generated 148 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:26:12.218573 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:26:12.219396 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=57 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:26:12.223560 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9fe576c7-8915-410c-a906-9f8ebfe631f3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-887181374", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1277045486", "security_groups": [{"name": "tempest-secgroup-smoke-1256671354"}], "block_device_mapping_v2": [{"uuid": "2e392387-4018-48b7-b17c-0fd72df0c13b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a58a68a2-3485-47fc-a402-341c963919cc"}]}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:26:12.337671 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.network.neutron [None req-9fe576c7-8915-410c-a906-9f8ebfe631f3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] validate_networks() for [('a58a68a2-3485-47fc-a402-341c963919cc', None, None, None, None, None)] {{(pid=120597) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 04:26:12.701081 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-9fe576c7-8915-410c-a906-9f8ebfe631f3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Flavor limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 04:26:12.701533 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-9fe576c7-8915-410c-a906-9f8ebfe631f3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Image limits 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 04:26:12.701998 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-9fe576c7-8915-410c-a906-9f8ebfe631f3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Flavor pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 04:26:12.702413 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-9fe576c7-8915-410c-a906-9f8ebfe631f3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Image pref 0:0:0 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 04:26:12.702832 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.virt.hardware [None req-9fe576c7-8915-410c-a906-9f8ebfe631f3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 04:26:12.711776 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fe576c7-8915-410c-a906-9f8ebfe631f3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:12.712265 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fe576c7-8915-410c-a906-9f8ebfe631f3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:12.712707 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fe576c7-8915-410c-a906-9f8ebfe631f3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:12.713480 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fe576c7-8915-410c-a906-9f8ebfe631f3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:12.713948 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fe576c7-8915-410c-a906-9f8ebfe631f3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:12.714381 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fe576c7-8915-410c-a906-9f8ebfe631f3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:12.731395 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-9fe576c7-8915-410c-a906-9f8ebfe631f3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Getting quotas for project 721dd52b82194e4d91113d4d688900ae. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:26:12.735366 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-9fe576c7-8915-410c-a906-9f8ebfe631f3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Getting quotas for user dea6fd8e6a374cd5b12ec7d99f285203 and project 721dd52b82194e4d91113d4d688900ae. Resources: {'ram', 'cores', 'instances'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:26:12.793590 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9fe576c7-8915-410c-a906-9f8ebfe631f3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Going to run 1 instances... {{(pid=120597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 04:26:12.795813 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9fe576c7-8915-410c-a906-9f8ebfe631f3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: d05ad71a-601e-42a7-a215-04477dc66444] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2e392387-4018-48b7-b17c-0fd72df0c13b',volume_size=None,volume_type=None)] {{(pid=120597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 04:26:12.925758 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9fe576c7-8915-410c-a906-9f8ebfe631f3 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.708768 Oct 01 04:26:12.932805 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 417/863] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 1 04:26:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 04:26:12.938644 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a2e3e8b1-4eba-4719-b15a-15aa80862627 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:12.939361 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d16f79d2-9d24-403b-b8ab-e048341cc994 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e4fbcdf-fc98-4acc-b274-20225bbfd273"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:26:12.939498 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a2e3e8b1-4eba-4719-b15a-15aa80862627 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: d05ad71a-601e-42a7-a215-04477dc66444] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:12.941864 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d16f79d2-9d24-403b-b8ab-e048341cc994 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 7666cbd6-6648-4f0b-ba58-7a95bd94700c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:12.949214 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d16f79d2-9d24-403b-b8ab-e048341cc994 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:12.949717 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d16f79d2-9d24-403b-b8ab-e048341cc994 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:12.950160 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d16f79d2-9d24-403b-b8ab-e048341cc994 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:12.950871 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d16f79d2-9d24-403b-b8ab-e048341cc994 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:12.951336 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d16f79d2-9d24-403b-b8ab-e048341cc994 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:12.951765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d16f79d2-9d24-403b-b8ab-e048341cc994 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:13.001776 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a2e3e8b1-4eba-4719-b15a-15aa80862627 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:26:13.009128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a2e3e8b1-4eba-4719-b15a-15aa80862627 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444" status: 200 len: 1094 microversion: 2.1 time: 0.074247 Oct 01 04:26:13.010626 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 447/864] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:26:12 2022] GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:26:13.206531 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d16f79d2-9d24-403b-b8ab-e048341cc994 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "POST /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271407 Oct 01 04:26:13.207136 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 418/865] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 1 04:26:12 2022] POST /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:26:14.032053 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5f272216-32e8-49d7-b9b4-c1ee5ef5a12b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:14.032584 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5f272216-32e8-49d7-b9b4-c1ee5ef5a12b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: d05ad71a-601e-42a7-a215-04477dc66444] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:14.040343 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f272216-32e8-49d7-b9b4-c1ee5ef5a12b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:14.040840 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f272216-32e8-49d7-b9b4-c1ee5ef5a12b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:14.041306 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f272216-32e8-49d7-b9b4-c1ee5ef5a12b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:14.042004 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f272216-32e8-49d7-b9b4-c1ee5ef5a12b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:14.042466 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f272216-32e8-49d7-b9b4-c1ee5ef5a12b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:14.042893 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5f272216-32e8-49d7-b9b4-c1ee5ef5a12b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:14.103699 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-5f272216-32e8-49d7-b9b4-c1ee5ef5a12b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:26:14.111320 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5f272216-32e8-49d7-b9b4-c1ee5ef5a12b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444" status: 200 len: 1192 microversion: 2.1 time: 0.083194 Oct 01 04:26:14.111883 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 448/866] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:26:14 2022] GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444 => generated 1192 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:26:15.136056 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8468f877-2501-4035-b8cd-79f64a6f3b6c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:15.136791 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8468f877-2501-4035-b8cd-79f64a6f3b6c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: d05ad71a-601e-42a7-a215-04477dc66444] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:15.144080 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8468f877-2501-4035-b8cd-79f64a6f3b6c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:15.144583 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8468f877-2501-4035-b8cd-79f64a6f3b6c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:15.145055 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8468f877-2501-4035-b8cd-79f64a6f3b6c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:15.145772 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8468f877-2501-4035-b8cd-79f64a6f3b6c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:15.148274 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8468f877-2501-4035-b8cd-79f64a6f3b6c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:15.148750 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8468f877-2501-4035-b8cd-79f64a6f3b6c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:15.288721 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-8468f877-2501-4035-b8cd-79f64a6f3b6c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:26:15.296566 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8468f877-2501-4035-b8cd-79f64a6f3b6c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444" status: 200 len: 1278 microversion: 2.1 time: 0.164781 Oct 01 04:26:15.297159 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 419/867] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:26:15 2022] GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444 => generated 1278 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:26:15.635413 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-1ecf81f2-46b2-46c9-81d7-34afcfae78b5 req-cb0777ff-ceb9-4e8e-945e-f2713b9095cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d05ad71a-601e-42a7-a215-04477dc66444", "tag": "1c202297-17f7-4fc4-9e9a-a51de8a73129"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:26:15.647254 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1ecf81f2-46b2-46c9-81d7-34afcfae78b5 req-cb0777ff-ceb9-4e8e-945e-f2713b9095cd service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:15.648403 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1ecf81f2-46b2-46c9-81d7-34afcfae78b5 req-cb0777ff-ceb9-4e8e-945e-f2713b9095cd service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:15.648863 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1ecf81f2-46b2-46c9-81d7-34afcfae78b5 req-cb0777ff-ceb9-4e8e-945e-f2713b9095cd service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:15.660210 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-1ecf81f2-46b2-46c9-81d7-34afcfae78b5 req-cb0777ff-ceb9-4e8e-945e-f2713b9095cd service nova] Creating event network-changed:1c202297-17f7-4fc4-9e9a-a51de8a73129 for instance d05ad71a-601e-42a7-a215-04477dc66444 on hv-cinder-86004 Oct 01 04:26:15.665942 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-1ecf81f2-46b2-46c9-81d7-34afcfae78b5 req-cb0777ff-ceb9-4e8e-945e-f2713b9095cd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035830 Oct 01 04:26:15.666531 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 449/868] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:26:16.320681 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c0e3312a-8ccb-41a5-b7aa-7cfa4ac267f0 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:16.321358 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c0e3312a-8ccb-41a5-b7aa-7cfa4ac267f0 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: d05ad71a-601e-42a7-a215-04477dc66444] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:16.327952 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0e3312a-8ccb-41a5-b7aa-7cfa4ac267f0 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:16.328454 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0e3312a-8ccb-41a5-b7aa-7cfa4ac267f0 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:16.328900 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0e3312a-8ccb-41a5-b7aa-7cfa4ac267f0 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:16.329761 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0e3312a-8ccb-41a5-b7aa-7cfa4ac267f0 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:16.330228 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0e3312a-8ccb-41a5-b7aa-7cfa4ac267f0 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:16.330663 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c0e3312a-8ccb-41a5-b7aa-7cfa4ac267f0 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:16.480442 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c0e3312a-8ccb-41a5-b7aa-7cfa4ac267f0 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:26:16.488149 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c0e3312a-8ccb-41a5-b7aa-7cfa4ac267f0 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444" status: 200 len: 1278 microversion: 2.1 time: 0.172114 Oct 01 04:26:16.495473 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 420/869] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:26:16 2022] GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444 => generated 1278 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:26:17.512619 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-5c2562d0-8731-4143-bff6-b63fd6c93a59 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:17.513382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-5c2562d0-8731-4143-bff6-b63fd6c93a59 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: d05ad71a-601e-42a7-a215-04477dc66444] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:17.519935 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c2562d0-8731-4143-bff6-b63fd6c93a59 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:17.520416 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c2562d0-8731-4143-bff6-b63fd6c93a59 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:17.521086 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c2562d0-8731-4143-bff6-b63fd6c93a59 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:17.521889 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c2562d0-8731-4143-bff6-b63fd6c93a59 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:17.522353 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c2562d0-8731-4143-bff6-b63fd6c93a59 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:17.522776 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-5c2562d0-8731-4143-bff6-b63fd6c93a59 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:17.653236 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-5c2562d0-8731-4143-bff6-b63fd6c93a59 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:26:17.660803 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-5c2562d0-8731-4143-bff6-b63fd6c93a59 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444" status: 200 len: 1278 microversion: 2.1 time: 0.152888 Oct 01 04:26:17.661940 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 450/870] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:26:17 2022] GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444 => generated 1278 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:26:18.683788 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-41a1fa82-47e8-45b4-952d-7d7f2601786c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:18.684440 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-41a1fa82-47e8-45b4-952d-7d7f2601786c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: d05ad71a-601e-42a7-a215-04477dc66444] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:18.690797 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41a1fa82-47e8-45b4-952d-7d7f2601786c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:18.691293 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41a1fa82-47e8-45b4-952d-7d7f2601786c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:18.691745 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41a1fa82-47e8-45b4-952d-7d7f2601786c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:18.692552 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41a1fa82-47e8-45b4-952d-7d7f2601786c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:18.693826 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41a1fa82-47e8-45b4-952d-7d7f2601786c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:18.694279 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-41a1fa82-47e8-45b4-952d-7d7f2601786c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:18.824433 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-41a1fa82-47e8-45b4-952d-7d7f2601786c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:26:18.832025 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-41a1fa82-47e8-45b4-952d-7d7f2601786c tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444" status: 200 len: 1278 microversion: 2.1 time: 0.152059 Oct 01 04:26:18.832580 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 421/871] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:26:18 2022] GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444 => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:26:19.735344 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-66b50efc-3134-454c-a0b7-d2fc933646f2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Action: 'create', calling method: .version_select at 0x7fdfbe652820>, body: {"keypair": {"name": "tempest-keypair-2136203695", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHeN8ZGEW74RjCiRUR3KS3IYfCEhw/Bj2kF8f6jTxjUAZEJTGHfkRAPPDVixujiiaa6ETAIDEhnauWB0H5xaLoQ45WZu09/c7rIiL0rJoh4qjcaaidaaFo7G9GhvJGEing=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:26:19.750708 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-66b50efc-3134-454c-a0b7-d2fc933646f2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Getting quotas for project 57f927e7829a4172b9919b964a9e7c13. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:26:19.754531 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-66b50efc-3134-454c-a0b7-d2fc933646f2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Getting quotas for user 0e30d69a25494d70bc094eb92c4f9bb0 and project 57f927e7829a4172b9919b964a9e7c13. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:26:19.776647 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-66b50efc-3134-454c-a0b7-d2fc933646f2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045269 Oct 01 04:26:19.777260 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 451/872] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 1 04:26:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:26:19.854234 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-625b417e-44d3-44ce-8946-c185147bcedf tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:19.855156 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-625b417e-44d3-44ce-8946-c185147bcedf tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: d05ad71a-601e-42a7-a215-04477dc66444] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:19.862415 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-625b417e-44d3-44ce-8946-c185147bcedf tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:19.862892 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-625b417e-44d3-44ce-8946-c185147bcedf tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:19.863330 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-625b417e-44d3-44ce-8946-c185147bcedf tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:19.864151 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-625b417e-44d3-44ce-8946-c185147bcedf tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:19.865406 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-625b417e-44d3-44ce-8946-c185147bcedf tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:19.865699 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-625b417e-44d3-44ce-8946-c185147bcedf tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:20.056416 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-625b417e-44d3-44ce-8946-c185147bcedf tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:26:20.064472 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-625b417e-44d3-44ce-8946-c185147bcedf tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444" status: 200 len: 1278 microversion: 2.1 time: 0.214123 Oct 01 04:26:20.065504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 422/873] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:26:19 2022] GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444 => generated 1278 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:26:21.067973 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a039a3bb-c09f-47a0-a4ff-0a55abb6994e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-961041674", "imageRef": "c63d52d7-4e3d-40cf-a8b5-59a2d027d793", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bddd7754-f392-4f22-b92b-c088917d60a6"}], "security_groups": [{"name": "tempest-securitygroup--1620619849"}], "key_name": "tempest-keypair-2136203695", "user_data": "}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:26:21.088471 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0352692e-a567-4940-b04c-d6a8f489a09f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:21.089105 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0352692e-a567-4940-b04c-d6a8f489a09f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: d05ad71a-601e-42a7-a215-04477dc66444] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:21.095261 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0352692e-a567-4940-b04c-d6a8f489a09f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:21.095815 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0352692e-a567-4940-b04c-d6a8f489a09f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:21.096257 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0352692e-a567-4940-b04c-d6a8f489a09f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:21.096974 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0352692e-a567-4940-b04c-d6a8f489a09f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:21.097439 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0352692e-a567-4940-b04c-d6a8f489a09f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:21.097866 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0352692e-a567-4940-b04c-d6a8f489a09f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:21.210852 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-a039a3bb-c09f-47a0-a4ff-0a55abb6994e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] validate_networks() for [('bddd7754-f392-4f22-b92b-c088917d60a6', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 04:26:21.523859 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-0352692e-a567-4940-b04c-d6a8f489a09f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:26:21.531615 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0352692e-a567-4940-b04c-d6a8f489a09f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444" status: 200 len: 1266 microversion: 2.1 time: 0.447903 Oct 01 04:26:21.532263 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 423/874] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:26:21 2022] GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444 => generated 1266 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:26:21.818398 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-a039a3bb-c09f-47a0-a4ff-0a55abb6994e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 04:26:21.818821 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-a039a3bb-c09f-47a0-a4ff-0a55abb6994e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 04:26:21.819327 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-a039a3bb-c09f-47a0-a4ff-0a55abb6994e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 04:26:21.819733 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-a039a3bb-c09f-47a0-a4ff-0a55abb6994e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 04:26:21.820145 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-a039a3bb-c09f-47a0-a4ff-0a55abb6994e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 04:26:21.828776 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a039a3bb-c09f-47a0-a4ff-0a55abb6994e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:21.829291 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a039a3bb-c09f-47a0-a4ff-0a55abb6994e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:21.829728 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a039a3bb-c09f-47a0-a4ff-0a55abb6994e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:21.830447 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a039a3bb-c09f-47a0-a4ff-0a55abb6994e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:21.830902 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a039a3bb-c09f-47a0-a4ff-0a55abb6994e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:21.831327 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a039a3bb-c09f-47a0-a4ff-0a55abb6994e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:21.848263 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-a039a3bb-c09f-47a0-a4ff-0a55abb6994e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Getting quotas for project 57f927e7829a4172b9919b964a9e7c13. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:26:21.852823 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-a039a3bb-c09f-47a0-a4ff-0a55abb6994e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Getting quotas for user 0e30d69a25494d70bc094eb92c4f9bb0 and project 57f927e7829a4172b9919b964a9e7c13. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:26:21.863503 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a039a3bb-c09f-47a0-a4ff-0a55abb6994e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 04:26:21.866658 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a039a3bb-c09f-47a0-a4ff-0a55abb6994e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 9c97834c-96c0-475f-90e5-f51da938482a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c63d52d7-4e3d-40cf-a8b5-59a2d027d793',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 04:26:21.912287 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a039a3bb-c09f-47a0-a4ff-0a55abb6994e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.849182 Oct 01 04:26:21.912943 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 452/875] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 1 04:26:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 04:26:21.924036 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3469200f-1a8b-4832-a5d0-73706dd0da24 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:21.924660 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3469200f-1a8b-4832-a5d0-73706dd0da24 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 9c97834c-96c0-475f-90e5-f51da938482a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:21.978416 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-3469200f-1a8b-4832-a5d0-73706dd0da24 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:26:21.985326 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3469200f-1a8b-4832-a5d0-73706dd0da24 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a" status: 200 len: 1241 microversion: 2.1 time: 0.065096 Oct 01 04:26:21.986234 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 424/876] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:26:21 2022] GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:26:22.556101 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1cc461ce-0b7f-40c1-8c96-26a8d5b02ce2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:22.556717 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1cc461ce-0b7f-40c1-8c96-26a8d5b02ce2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: d05ad71a-601e-42a7-a215-04477dc66444] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:22.562750 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cc461ce-0b7f-40c1-8c96-26a8d5b02ce2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:22.563235 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cc461ce-0b7f-40c1-8c96-26a8d5b02ce2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:22.563673 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cc461ce-0b7f-40c1-8c96-26a8d5b02ce2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:22.564368 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cc461ce-0b7f-40c1-8c96-26a8d5b02ce2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:22.564823 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cc461ce-0b7f-40c1-8c96-26a8d5b02ce2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:22.565273 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1cc461ce-0b7f-40c1-8c96-26a8d5b02ce2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:22.701469 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1cc461ce-0b7f-40c1-8c96-26a8d5b02ce2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:26:22.709983 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1cc461ce-0b7f-40c1-8c96-26a8d5b02ce2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444" status: 200 len: 1266 microversion: 2.1 time: 0.158852 Oct 01 04:26:22.710573 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 453/877] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:26:22 2022] GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:26:23.011572 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-97c624da-86b7-4009-bfb3-2f6723f8a95e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:23.013938 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-97c624da-86b7-4009-bfb3-2f6723f8a95e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 9c97834c-96c0-475f-90e5-f51da938482a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:23.016607 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:26:23.023346 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97c624da-86b7-4009-bfb3-2f6723f8a95e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:23.023917 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97c624da-86b7-4009-bfb3-2f6723f8a95e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:23.024410 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97c624da-86b7-4009-bfb3-2f6723f8a95e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:23.025176 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97c624da-86b7-4009-bfb3-2f6723f8a95e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:23.025640 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97c624da-86b7-4009-bfb3-2f6723f8a95e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:23.026170 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-97c624da-86b7-4009-bfb3-2f6723f8a95e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:23.096516 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-97c624da-86b7-4009-bfb3-2f6723f8a95e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:26:23.105522 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-97c624da-86b7-4009-bfb3-2f6723f8a95e tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a" status: 200 len: 1311 microversion: 2.1 time: 0.100180 Oct 01 04:26:23.106036 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 425/878] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:26:23 2022] GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:26:23.733303 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2c75946b-18ec-4fe7-8d7a-b6f6ec71aec2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:23.733909 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2c75946b-18ec-4fe7-8d7a-b6f6ec71aec2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: d05ad71a-601e-42a7-a215-04477dc66444] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:23.742776 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c75946b-18ec-4fe7-8d7a-b6f6ec71aec2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:23.743265 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c75946b-18ec-4fe7-8d7a-b6f6ec71aec2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:23.743700 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c75946b-18ec-4fe7-8d7a-b6f6ec71aec2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:23.744503 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c75946b-18ec-4fe7-8d7a-b6f6ec71aec2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:23.744848 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c75946b-18ec-4fe7-8d7a-b6f6ec71aec2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:23.745300 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2c75946b-18ec-4fe7-8d7a-b6f6ec71aec2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:23.900107 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2c75946b-18ec-4fe7-8d7a-b6f6ec71aec2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:26:23.909055 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2c75946b-18ec-4fe7-8d7a-b6f6ec71aec2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444" status: 200 len: 1266 microversion: 2.1 time: 0.180031 Oct 01 04:26:23.909658 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 454/879] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:26:23 2022] GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:26:24.129043 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c4040674-f193-4618-b375-cee435c9d4ff tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:24.130307 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c4040674-f193-4618-b375-cee435c9d4ff tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 9c97834c-96c0-475f-90e5-f51da938482a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:24.136794 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4040674-f193-4618-b375-cee435c9d4ff tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:24.137372 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4040674-f193-4618-b375-cee435c9d4ff tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:24.137871 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4040674-f193-4618-b375-cee435c9d4ff tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:24.138631 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4040674-f193-4618-b375-cee435c9d4ff tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:24.139161 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4040674-f193-4618-b375-cee435c9d4ff tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:24.139651 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c4040674-f193-4618-b375-cee435c9d4ff tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:24.275685 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c4040674-f193-4618-b375-cee435c9d4ff tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:26:24.283822 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c4040674-f193-4618-b375-cee435c9d4ff tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a" status: 200 len: 1367 microversion: 2.1 time: 0.158675 Oct 01 04:26:24.284393 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 426/880] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:26:24 2022] GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:26:24.423458 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-17e9e7c9-cb6e-42a5-8a6e-cf087b544e0e req-799c5223-f331-4a30-9a33-d68d7afa40e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c97834c-96c0-475f-90e5-f51da938482a", "tag": "d2f63b7f-13d5-4488-afdf-ac0c1ff404e5"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:26:24.439632 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-17e9e7c9-cb6e-42a5-8a6e-cf087b544e0e req-799c5223-f331-4a30-9a33-d68d7afa40e3 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:24.440148 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-17e9e7c9-cb6e-42a5-8a6e-cf087b544e0e req-799c5223-f331-4a30-9a33-d68d7afa40e3 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:24.440570 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-17e9e7c9-cb6e-42a5-8a6e-cf087b544e0e req-799c5223-f331-4a30-9a33-d68d7afa40e3 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:24.451698 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-17e9e7c9-cb6e-42a5-8a6e-cf087b544e0e req-799c5223-f331-4a30-9a33-d68d7afa40e3 service nova] Creating event network-changed:d2f63b7f-13d5-4488-afdf-ac0c1ff404e5 for instance 9c97834c-96c0-475f-90e5-f51da938482a on hv-cinder-86004 Oct 01 04:26:24.456468 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-17e9e7c9-cb6e-42a5-8a6e-cf087b544e0e req-799c5223-f331-4a30-9a33-d68d7afa40e3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037178 Oct 01 04:26:24.457086 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 455/881] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:26:24.932859 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a4407c74-eaeb-492e-bab6-de162398630b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:24.933604 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a4407c74-eaeb-492e-bab6-de162398630b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: d05ad71a-601e-42a7-a215-04477dc66444] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:24.939480 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4407c74-eaeb-492e-bab6-de162398630b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:24.939970 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4407c74-eaeb-492e-bab6-de162398630b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:24.940407 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4407c74-eaeb-492e-bab6-de162398630b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:24.941133 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4407c74-eaeb-492e-bab6-de162398630b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:24.941598 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4407c74-eaeb-492e-bab6-de162398630b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:24.942029 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a4407c74-eaeb-492e-bab6-de162398630b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:25.075448 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-a4407c74-eaeb-492e-bab6-de162398630b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:26:25.083804 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a4407c74-eaeb-492e-bab6-de162398630b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444" status: 200 len: 1266 microversion: 2.1 time: 0.154099 Oct 01 04:26:25.084371 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 427/882] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:26:24 2022] GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:26:25.309035 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-510c4dc9-9e5f-48e4-b379-bcf651c96540 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:25.309695 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-510c4dc9-9e5f-48e4-b379-bcf651c96540 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 9c97834c-96c0-475f-90e5-f51da938482a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:25.315859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-510c4dc9-9e5f-48e4-b379-bcf651c96540 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:25.316350 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-510c4dc9-9e5f-48e4-b379-bcf651c96540 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:25.316792 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-510c4dc9-9e5f-48e4-b379-bcf651c96540 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:25.318559 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-510c4dc9-9e5f-48e4-b379-bcf651c96540 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:25.319076 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-510c4dc9-9e5f-48e4-b379-bcf651c96540 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:25.319510 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-510c4dc9-9e5f-48e4-b379-bcf651c96540 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:25.451855 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-510c4dc9-9e5f-48e4-b379-bcf651c96540 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:26:25.459346 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-510c4dc9-9e5f-48e4-b379-bcf651c96540 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a" status: 200 len: 1367 microversion: 2.1 time: 0.155130 Oct 01 04:26:25.459931 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 456/883] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:26:25 2022] GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:26:26.106510 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f51b4fb4-7ece-4b46-9ded-8bc261011488 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:26.107057 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f51b4fb4-7ece-4b46-9ded-8bc261011488 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: d05ad71a-601e-42a7-a215-04477dc66444] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:26.113501 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f51b4fb4-7ece-4b46-9ded-8bc261011488 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:26.114024 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f51b4fb4-7ece-4b46-9ded-8bc261011488 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:26.114504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f51b4fb4-7ece-4b46-9ded-8bc261011488 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:26.115211 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f51b4fb4-7ece-4b46-9ded-8bc261011488 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:26.115677 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f51b4fb4-7ece-4b46-9ded-8bc261011488 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:26.116104 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f51b4fb4-7ece-4b46-9ded-8bc261011488 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:26.248391 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-f51b4fb4-7ece-4b46-9ded-8bc261011488 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:26:26.256690 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f51b4fb4-7ece-4b46-9ded-8bc261011488 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444" status: 200 len: 1266 microversion: 2.1 time: 0.154119 Oct 01 04:26:26.257292 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 428/884] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:26:26 2022] GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:26:26.482531 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1e056971-87d9-4a13-98f9-bfea532cd210 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:26.483147 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1e056971-87d9-4a13-98f9-bfea532cd210 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 9c97834c-96c0-475f-90e5-f51da938482a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:26.489488 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e056971-87d9-4a13-98f9-bfea532cd210 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:26.489968 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e056971-87d9-4a13-98f9-bfea532cd210 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:26.490395 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e056971-87d9-4a13-98f9-bfea532cd210 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:26.491083 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e056971-87d9-4a13-98f9-bfea532cd210 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:26.491538 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e056971-87d9-4a13-98f9-bfea532cd210 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:26.491959 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1e056971-87d9-4a13-98f9-bfea532cd210 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:26.631363 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1e056971-87d9-4a13-98f9-bfea532cd210 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:26:26.639126 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1e056971-87d9-4a13-98f9-bfea532cd210 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a" status: 200 len: 1367 microversion: 2.1 time: 0.160403 Oct 01 04:26:26.653289 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 457/885] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:26:26 2022] GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:26:27.279974 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6eb4fd58-8cd6-4309-95e2-973250ebb871 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:27.280499 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6eb4fd58-8cd6-4309-95e2-973250ebb871 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: d05ad71a-601e-42a7-a215-04477dc66444] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:27.287326 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6eb4fd58-8cd6-4309-95e2-973250ebb871 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:27.287820 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6eb4fd58-8cd6-4309-95e2-973250ebb871 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:27.288262 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6eb4fd58-8cd6-4309-95e2-973250ebb871 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:27.288993 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6eb4fd58-8cd6-4309-95e2-973250ebb871 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:27.289456 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6eb4fd58-8cd6-4309-95e2-973250ebb871 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:27.289886 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6eb4fd58-8cd6-4309-95e2-973250ebb871 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:27.418496 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-6eb4fd58-8cd6-4309-95e2-973250ebb871 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:26:27.426055 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6eb4fd58-8cd6-4309-95e2-973250ebb871 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444" status: 200 len: 1266 microversion: 2.1 time: 0.150288 Oct 01 04:26:27.427136 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 429/886] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:26:27 2022] GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:26:27.663201 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-005c9c9d-8e82-40ea-8cb0-065905eb70f9 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:27.663751 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-005c9c9d-8e82-40ea-8cb0-065905eb70f9 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 9c97834c-96c0-475f-90e5-f51da938482a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:27.670094 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-005c9c9d-8e82-40ea-8cb0-065905eb70f9 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:27.670621 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-005c9c9d-8e82-40ea-8cb0-065905eb70f9 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:27.671062 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-005c9c9d-8e82-40ea-8cb0-065905eb70f9 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:27.671759 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-005c9c9d-8e82-40ea-8cb0-065905eb70f9 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:27.672219 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-005c9c9d-8e82-40ea-8cb0-065905eb70f9 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:27.672646 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-005c9c9d-8e82-40ea-8cb0-065905eb70f9 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:27.800064 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-005c9c9d-8e82-40ea-8cb0-065905eb70f9 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:26:27.808382 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-005c9c9d-8e82-40ea-8cb0-065905eb70f9 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a" status: 200 len: 1367 microversion: 2.1 time: 0.149166 Oct 01 04:26:27.808948 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 458/887] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:26:27 2022] GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:26:28.449427 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cfecfafe-eac9-47f1-810f-f9de7823a5aa tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:28.450074 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cfecfafe-eac9-47f1-810f-f9de7823a5aa tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: d05ad71a-601e-42a7-a215-04477dc66444] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:28.456426 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cfecfafe-eac9-47f1-810f-f9de7823a5aa tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:28.456940 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cfecfafe-eac9-47f1-810f-f9de7823a5aa tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:28.457390 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cfecfafe-eac9-47f1-810f-f9de7823a5aa tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:28.459258 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cfecfafe-eac9-47f1-810f-f9de7823a5aa tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:28.459729 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cfecfafe-eac9-47f1-810f-f9de7823a5aa tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:28.460165 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cfecfafe-eac9-47f1-810f-f9de7823a5aa tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:28.594536 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-cfecfafe-eac9-47f1-810f-f9de7823a5aa tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:26:28.602473 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cfecfafe-eac9-47f1-810f-f9de7823a5aa tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444" status: 200 len: 1266 microversion: 2.1 time: 0.156894 Oct 01 04:26:28.603248 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 430/888] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:26:28 2022] GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:26:28.831224 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c3a469f1-d1cb-4611-8765-2c758374f1ca tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:28.831848 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c3a469f1-d1cb-4611-8765-2c758374f1ca tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 9c97834c-96c0-475f-90e5-f51da938482a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:28.838582 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3a469f1-d1cb-4611-8765-2c758374f1ca tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:28.839073 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3a469f1-d1cb-4611-8765-2c758374f1ca tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:28.839514 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3a469f1-d1cb-4611-8765-2c758374f1ca tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:28.840220 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3a469f1-d1cb-4611-8765-2c758374f1ca tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:28.840681 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3a469f1-d1cb-4611-8765-2c758374f1ca tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:28.841156 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c3a469f1-d1cb-4611-8765-2c758374f1ca tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:28.887130 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-ae1d712c-8361-4452-a9e5-bc4128c4a659 req-95b8f2a1-7af8-4003-8f70-c4e8e2042b70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c97834c-96c0-475f-90e5-f51da938482a", "name": "network-vif-plugged", "status": "completed", "tag": "d2f63b7f-13d5-4488-afdf-ac0c1ff404e5"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:26:28.896896 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ae1d712c-8361-4452-a9e5-bc4128c4a659 req-95b8f2a1-7af8-4003-8f70-c4e8e2042b70 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:28.897643 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ae1d712c-8361-4452-a9e5-bc4128c4a659 req-95b8f2a1-7af8-4003-8f70-c4e8e2042b70 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:28.898083 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ae1d712c-8361-4452-a9e5-bc4128c4a659 req-95b8f2a1-7af8-4003-8f70-c4e8e2042b70 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:28.910138 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-ae1d712c-8361-4452-a9e5-bc4128c4a659 req-95b8f2a1-7af8-4003-8f70-c4e8e2042b70 service nova] Creating event network-vif-plugged:d2f63b7f-13d5-4488-afdf-ac0c1ff404e5 for instance 9c97834c-96c0-475f-90e5-f51da938482a on hv-cinder-86004 Oct 01 04:26:28.915166 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-ae1d712c-8361-4452-a9e5-bc4128c4a659 req-95b8f2a1-7af8-4003-8f70-c4e8e2042b70 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032085 Oct 01 04:26:28.915933 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 431/889] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:26:28.978495 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c3a469f1-d1cb-4611-8765-2c758374f1ca tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:26:28.987565 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c3a469f1-d1cb-4611-8765-2c758374f1ca tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a" status: 200 len: 1367 microversion: 2.1 time: 0.160190 Oct 01 04:26:28.988393 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 459/890] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:26:28 2022] GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:26:29.625979 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2856354d-981a-4818-a7b9-f1146c8ae9ac tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:29.626679 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-2856354d-981a-4818-a7b9-f1146c8ae9ac tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: d05ad71a-601e-42a7-a215-04477dc66444] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:29.632822 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2856354d-981a-4818-a7b9-f1146c8ae9ac tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:29.633333 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2856354d-981a-4818-a7b9-f1146c8ae9ac tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:29.633766 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2856354d-981a-4818-a7b9-f1146c8ae9ac tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:29.634453 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2856354d-981a-4818-a7b9-f1146c8ae9ac tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:29.634910 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2856354d-981a-4818-a7b9-f1146c8ae9ac tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:29.635331 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-2856354d-981a-4818-a7b9-f1146c8ae9ac tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:29.767228 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-2856354d-981a-4818-a7b9-f1146c8ae9ac tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:26:29.776211 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2856354d-981a-4818-a7b9-f1146c8ae9ac tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444" status: 200 len: 1266 microversion: 2.1 time: 0.154843 Oct 01 04:26:29.776708 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 432/891] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:26:29 2022] GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:26:30.012278 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-865d5909-40d9-4c5b-a1f2-a896ebd68d93 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:30.012882 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-865d5909-40d9-4c5b-a1f2-a896ebd68d93 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 9c97834c-96c0-475f-90e5-f51da938482a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:30.019570 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-865d5909-40d9-4c5b-a1f2-a896ebd68d93 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:30.020083 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-865d5909-40d9-4c5b-a1f2-a896ebd68d93 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:30.020523 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-865d5909-40d9-4c5b-a1f2-a896ebd68d93 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:30.021258 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-865d5909-40d9-4c5b-a1f2-a896ebd68d93 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:30.022468 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-865d5909-40d9-4c5b-a1f2-a896ebd68d93 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:30.022875 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-865d5909-40d9-4c5b-a1f2-a896ebd68d93 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:30.151532 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-865d5909-40d9-4c5b-a1f2-a896ebd68d93 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:26:30.159224 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-865d5909-40d9-4c5b-a1f2-a896ebd68d93 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a" status: 200 len: 1367 microversion: 2.1 time: 0.150812 Oct 01 04:26:30.159824 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 460/892] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:26:30 2022] GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:26:30.799427 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b064b05e-68cb-4d97-bc2d-3eda6a29f3d2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:30.800055 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b064b05e-68cb-4d97-bc2d-3eda6a29f3d2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: d05ad71a-601e-42a7-a215-04477dc66444] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:30.807126 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b064b05e-68cb-4d97-bc2d-3eda6a29f3d2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:30.807617 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b064b05e-68cb-4d97-bc2d-3eda6a29f3d2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:30.808062 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b064b05e-68cb-4d97-bc2d-3eda6a29f3d2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:30.808759 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b064b05e-68cb-4d97-bc2d-3eda6a29f3d2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:30.809249 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b064b05e-68cb-4d97-bc2d-3eda6a29f3d2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:30.809681 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b064b05e-68cb-4d97-bc2d-3eda6a29f3d2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:30.939842 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-383c6dda-ef35-46a4-939f-8d21daf73391 req-eb382097-c584-4b73-89c3-d48578486784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d05ad71a-601e-42a7-a215-04477dc66444", "name": "network-vif-plugged", "status": "completed", "tag": "1c202297-17f7-4fc4-9e9a-a51de8a73129"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:26:30.942875 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-b064b05e-68cb-4d97-bc2d-3eda6a29f3d2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:26:30.949433 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-383c6dda-ef35-46a4-939f-8d21daf73391 req-eb382097-c584-4b73-89c3-d48578486784 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:30.949910 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-383c6dda-ef35-46a4-939f-8d21daf73391 req-eb382097-c584-4b73-89c3-d48578486784 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:30.950342 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-383c6dda-ef35-46a4-939f-8d21daf73391 req-eb382097-c584-4b73-89c3-d48578486784 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:30.950563 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b064b05e-68cb-4d97-bc2d-3eda6a29f3d2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444" status: 200 len: 1266 microversion: 2.1 time: 0.154947 Oct 01 04:26:30.951141 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 433/893] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:26:30 2022] GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:26:30.963155 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-383c6dda-ef35-46a4-939f-8d21daf73391 req-eb382097-c584-4b73-89c3-d48578486784 service nova] Creating event network-vif-plugged:1c202297-17f7-4fc4-9e9a-a51de8a73129 for instance d05ad71a-601e-42a7-a215-04477dc66444 on hv-cinder-86004 Oct 01 04:26:30.967969 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-383c6dda-ef35-46a4-939f-8d21daf73391 req-eb382097-c584-4b73-89c3-d48578486784 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031802 Oct 01 04:26:30.968707 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 461/894] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:26:31.182978 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7140093e-d0fa-4e19-a6ad-47f215fbfb49 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:31.183596 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7140093e-d0fa-4e19-a6ad-47f215fbfb49 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 9c97834c-96c0-475f-90e5-f51da938482a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:31.189556 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7140093e-d0fa-4e19-a6ad-47f215fbfb49 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:31.190080 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7140093e-d0fa-4e19-a6ad-47f215fbfb49 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:31.190521 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7140093e-d0fa-4e19-a6ad-47f215fbfb49 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:31.191228 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7140093e-d0fa-4e19-a6ad-47f215fbfb49 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:31.191691 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7140093e-d0fa-4e19-a6ad-47f215fbfb49 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:31.192121 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7140093e-d0fa-4e19-a6ad-47f215fbfb49 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:31.212347 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:26:31.325019 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-7140093e-d0fa-4e19-a6ad-47f215fbfb49 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:26:31.332613 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7140093e-d0fa-4e19-a6ad-47f215fbfb49 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a" status: 200 len: 1555 microversion: 2.1 time: 0.154051 Oct 01 04:26:31.333205 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 434/895] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:26:31 2022] GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:26:31.357539 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-07b5b75f-bf3a-4e7b-b316-2010823f7b05 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:31.358126 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-07b5b75f-bf3a-4e7b-b316-2010823f7b05 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 9c97834c-96c0-475f-90e5-f51da938482a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:31.364157 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07b5b75f-bf3a-4e7b-b316-2010823f7b05 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:31.364640 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07b5b75f-bf3a-4e7b-b316-2010823f7b05 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:31.365203 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07b5b75f-bf3a-4e7b-b316-2010823f7b05 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:31.366119 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07b5b75f-bf3a-4e7b-b316-2010823f7b05 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:31.366581 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07b5b75f-bf3a-4e7b-b316-2010823f7b05 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:31.367008 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-07b5b75f-bf3a-4e7b-b316-2010823f7b05 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:31.446910 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-07b5b75f-bf3a-4e7b-b316-2010823f7b05 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094020 Oct 01 04:26:31.447497 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 462/896] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 1 04:26:31 2022] GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:26:31.973928 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-82d22415-648b-4399-954a-405f2e5624c7 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:31.975889 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-82d22415-648b-4399-954a-405f2e5624c7 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: d05ad71a-601e-42a7-a215-04477dc66444] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:31.982356 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82d22415-648b-4399-954a-405f2e5624c7 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:31.983158 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82d22415-648b-4399-954a-405f2e5624c7 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:31.983603 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82d22415-648b-4399-954a-405f2e5624c7 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:31.984491 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82d22415-648b-4399-954a-405f2e5624c7 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:31.984987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82d22415-648b-4399-954a-405f2e5624c7 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:31.985423 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-82d22415-648b-4399-954a-405f2e5624c7 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:31.986051 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=8 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:26:32.209503 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-82d22415-648b-4399-954a-405f2e5624c7 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:26:32.217475 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-82d22415-648b-4399-954a-405f2e5624c7 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444" status: 200 len: 1266 microversion: 2.1 time: 0.247563 Oct 01 04:26:32.218037 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 435/897] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:26:31 2022] GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444 => generated 1266 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:26:32.452014 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:26:32.452799 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=12 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:26:32.457274 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-c8e8a289-240a-4c68-940c-4c5ed0a9bb99 req-a97b327f-1ab5-401b-a042-1febb5290817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c97834c-96c0-475f-90e5-f51da938482a", "tag": "d2f63b7f-13d5-4488-afdf-ac0c1ff404e5"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:26:32.468887 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c8e8a289-240a-4c68-940c-4c5ed0a9bb99 req-a97b327f-1ab5-401b-a042-1febb5290817 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:32.469421 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c8e8a289-240a-4c68-940c-4c5ed0a9bb99 req-a97b327f-1ab5-401b-a042-1febb5290817 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:32.469856 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-c8e8a289-240a-4c68-940c-4c5ed0a9bb99 req-a97b327f-1ab5-401b-a042-1febb5290817 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:32.484555 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-c8e8a289-240a-4c68-940c-4c5ed0a9bb99 req-a97b327f-1ab5-401b-a042-1febb5290817 service nova] Creating event network-changed:d2f63b7f-13d5-4488-afdf-ac0c1ff404e5 for instance 9c97834c-96c0-475f-90e5-f51da938482a on hv-cinder-86004 Oct 01 04:26:32.489886 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-c8e8a289-240a-4c68-940c-4c5ed0a9bb99 req-a97b327f-1ab5-401b-a042-1febb5290817 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038233 Oct 01 04:26:32.491229 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 463/898] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:26:33.243167 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-59aea341-a36c-4e4b-8473-bad2a7b602ec tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:33.243794 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-59aea341-a36c-4e4b-8473-bad2a7b602ec tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: d05ad71a-601e-42a7-a215-04477dc66444] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:33.250599 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59aea341-a36c-4e4b-8473-bad2a7b602ec tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:33.251120 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59aea341-a36c-4e4b-8473-bad2a7b602ec tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:33.251856 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59aea341-a36c-4e4b-8473-bad2a7b602ec tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:33.252604 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59aea341-a36c-4e4b-8473-bad2a7b602ec tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:33.253159 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59aea341-a36c-4e4b-8473-bad2a7b602ec tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:33.253640 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-59aea341-a36c-4e4b-8473-bad2a7b602ec tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:33.398669 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-59aea341-a36c-4e4b-8473-bad2a7b602ec tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:26:33.406405 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-59aea341-a36c-4e4b-8473-bad2a7b602ec tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444" status: 200 len: 1453 microversion: 2.1 time: 0.167854 Oct 01 04:26:33.407254 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 436/899] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:26:33 2022] GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444 => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:26:33.430164 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-96b56f7c-26ae-49cc-9f96-ac568b985e22 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:26:33.430980 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-96b56f7c-26ae-49cc-9f96-ac568b985e22 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: d05ad71a-601e-42a7-a215-04477dc66444] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:26:33.439674 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96b56f7c-26ae-49cc-9f96-ac568b985e22 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:33.440334 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96b56f7c-26ae-49cc-9f96-ac568b985e22 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:33.440779 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96b56f7c-26ae-49cc-9f96-ac568b985e22 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:33.441542 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96b56f7c-26ae-49cc-9f96-ac568b985e22 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:33.441999 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96b56f7c-26ae-49cc-9f96-ac568b985e22 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:33.442432 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-96b56f7c-26ae-49cc-9f96-ac568b985e22 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:33.582665 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-96b56f7c-26ae-49cc-9f96-ac568b985e22 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:26:33.590431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-96b56f7c-26ae-49cc-9f96-ac568b985e22 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444" status: 200 len: 1453 microversion: 2.1 time: 0.164735 Oct 01 04:26:33.591001 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 464/900] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:26:33 2022] GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444 => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:26:35.386160 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-ddb09e22-48f2-4281-860d-565aa50c2cbb req-86c99f68-04fe-4d27-b699-bde68c15e8c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d05ad71a-601e-42a7-a215-04477dc66444", "tag": "1c202297-17f7-4fc4-9e9a-a51de8a73129"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:26:35.396302 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ddb09e22-48f2-4281-860d-565aa50c2cbb req-86c99f68-04fe-4d27-b699-bde68c15e8c4 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:26:35.396880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ddb09e22-48f2-4281-860d-565aa50c2cbb req-86c99f68-04fe-4d27-b699-bde68c15e8c4 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:26:35.397467 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-ddb09e22-48f2-4281-860d-565aa50c2cbb req-86c99f68-04fe-4d27-b699-bde68c15e8c4 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:26:35.408885 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-ddb09e22-48f2-4281-860d-565aa50c2cbb req-86c99f68-04fe-4d27-b699-bde68c15e8c4 service nova] Creating event network-changed:1c202297-17f7-4fc4-9e9a-a51de8a73129 for instance d05ad71a-601e-42a7-a215-04477dc66444 on hv-cinder-86004 Oct 01 04:26:35.414608 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-ddb09e22-48f2-4281-860d-565aa50c2cbb req-86c99f68-04fe-4d27-b699-bde68c15e8c4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032185 Oct 01 04:26:35.415323 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 437/901] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:27:01.033632 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7ea8f1c9-4c61-468e-9a3f-23d7d7b94f3f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:27:01.034228 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7ea8f1c9-4c61-468e-9a3f-23d7d7b94f3f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:01.036645 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:27:01.037856 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=78 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:27:01.043750 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ea8f1c9-4c61-468e-9a3f-23d7d7b94f3f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:01.044233 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ea8f1c9-4c61-468e-9a3f-23d7d7b94f3f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:01.044666 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ea8f1c9-4c61-468e-9a3f-23d7d7b94f3f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:01.045389 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ea8f1c9-4c61-468e-9a3f-23d7d7b94f3f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:01.045840 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ea8f1c9-4c61-468e-9a3f-23d7d7b94f3f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:01.046260 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7ea8f1c9-4c61-468e-9a3f-23d7d7b94f3f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:01.069971 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-7ea8f1c9-4c61-468e-9a3f-23d7d7b94f3f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lazy-loading 'flavor' on Instance uuid 2af93c94-483f-4f6d-a017-d45ef01bac8d {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:27:01.139575 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7ea8f1c9-4c61-468e-9a3f-23d7d7b94f3f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "POST /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d/action" status: 202 len: 0 microversion: 2.1 time: 0.109671 Oct 01 04:27:01.140216 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 465/902] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 1 04:27:01 2022] POST /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 04:27:01.146859 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:27:01.147634 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=16 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:27:01.152080 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-22414f24-66c6-41fa-9a47-358e8e518971 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:01.152797 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-22414f24-66c6-41fa-9a47-358e8e518971 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:01.160333 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22414f24-66c6-41fa-9a47-358e8e518971 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:01.160890 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22414f24-66c6-41fa-9a47-358e8e518971 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:01.161345 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22414f24-66c6-41fa-9a47-358e8e518971 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:01.162587 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22414f24-66c6-41fa-9a47-358e8e518971 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:01.163041 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22414f24-66c6-41fa-9a47-358e8e518971 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:01.163593 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22414f24-66c6-41fa-9a47-358e8e518971 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:01.295330 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-22414f24-66c6-41fa-9a47-358e8e518971 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:01.303878 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-22414f24-66c6-41fa-9a47-358e8e518971 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1569 microversion: 2.1 time: 0.157987 Oct 01 04:27:01.304452 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 438/903] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:01 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:02.327923 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-80d97aa2-2a98-4cfb-8401-508dc37051d8 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:02.328631 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-80d97aa2-2a98-4cfb-8401-508dc37051d8 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:02.335035 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80d97aa2-2a98-4cfb-8401-508dc37051d8 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:02.335523 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80d97aa2-2a98-4cfb-8401-508dc37051d8 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:02.335965 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80d97aa2-2a98-4cfb-8401-508dc37051d8 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:02.336695 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80d97aa2-2a98-4cfb-8401-508dc37051d8 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:02.337193 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80d97aa2-2a98-4cfb-8401-508dc37051d8 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:02.337626 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-80d97aa2-2a98-4cfb-8401-508dc37051d8 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:02.473998 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-80d97aa2-2a98-4cfb-8401-508dc37051d8 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:02.481741 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-80d97aa2-2a98-4cfb-8401-508dc37051d8 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1569 microversion: 2.1 time: 0.158532 Oct 01 04:27:02.482303 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 466/904] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:02 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:03.505080 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a5c2fe0a-8986-43c9-8a62-a75ceb1a0644 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:03.505781 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a5c2fe0a-8986-43c9-8a62-a75ceb1a0644 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:03.512317 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5c2fe0a-8986-43c9-8a62-a75ceb1a0644 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:03.512803 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5c2fe0a-8986-43c9-8a62-a75ceb1a0644 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:03.513275 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5c2fe0a-8986-43c9-8a62-a75ceb1a0644 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:03.513969 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5c2fe0a-8986-43c9-8a62-a75ceb1a0644 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:03.514427 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5c2fe0a-8986-43c9-8a62-a75ceb1a0644 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:03.514853 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a5c2fe0a-8986-43c9-8a62-a75ceb1a0644 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:03.644216 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-a5c2fe0a-8986-43c9-8a62-a75ceb1a0644 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:03.652679 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a5c2fe0a-8986-43c9-8a62-a75ceb1a0644 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1569 microversion: 2.1 time: 0.151501 Oct 01 04:27:03.653265 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 439/905] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:03 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:04.676371 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-be8ff72c-13d3-4801-aab2-e8d444c8677c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:04.677002 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-be8ff72c-13d3-4801-aab2-e8d444c8677c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:04.684167 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be8ff72c-13d3-4801-aab2-e8d444c8677c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:04.684644 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be8ff72c-13d3-4801-aab2-e8d444c8677c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:04.685102 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be8ff72c-13d3-4801-aab2-e8d444c8677c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:04.685787 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be8ff72c-13d3-4801-aab2-e8d444c8677c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:04.686239 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be8ff72c-13d3-4801-aab2-e8d444c8677c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:04.686660 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-be8ff72c-13d3-4801-aab2-e8d444c8677c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:04.818227 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-be8ff72c-13d3-4801-aab2-e8d444c8677c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:04.825940 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-be8ff72c-13d3-4801-aab2-e8d444c8677c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1569 microversion: 2.1 time: 0.153428 Oct 01 04:27:04.826506 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 467/906] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:04 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:05.849255 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-02a39c13-1323-4771-860d-aff12fd6b1a7 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:05.850011 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-02a39c13-1323-4771-860d-aff12fd6b1a7 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:05.856260 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02a39c13-1323-4771-860d-aff12fd6b1a7 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:05.856741 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02a39c13-1323-4771-860d-aff12fd6b1a7 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:05.857207 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02a39c13-1323-4771-860d-aff12fd6b1a7 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:05.857902 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02a39c13-1323-4771-860d-aff12fd6b1a7 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:05.858361 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02a39c13-1323-4771-860d-aff12fd6b1a7 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:05.858785 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-02a39c13-1323-4771-860d-aff12fd6b1a7 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:05.987598 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-02a39c13-1323-4771-860d-aff12fd6b1a7 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:05.996475 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-02a39c13-1323-4771-860d-aff12fd6b1a7 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1569 microversion: 2.1 time: 0.151211 Oct 01 04:27:05.997073 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 440/907] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:05 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:07.019918 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-a9222feb-1fdb-41fe-9551-53729c4edf8d tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:07.020539 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-a9222feb-1fdb-41fe-9551-53729c4edf8d tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:07.027777 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9222feb-1fdb-41fe-9551-53729c4edf8d tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:07.028272 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9222feb-1fdb-41fe-9551-53729c4edf8d tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:07.028719 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9222feb-1fdb-41fe-9551-53729c4edf8d tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:07.029452 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9222feb-1fdb-41fe-9551-53729c4edf8d tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:07.029946 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9222feb-1fdb-41fe-9551-53729c4edf8d tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:07.030376 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-a9222feb-1fdb-41fe-9551-53729c4edf8d tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:07.165709 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-a9222feb-1fdb-41fe-9551-53729c4edf8d tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:07.173351 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-a9222feb-1fdb-41fe-9551-53729c4edf8d tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1569 microversion: 2.1 time: 0.157562 Oct 01 04:27:07.173946 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 468/908] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:07 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:08.197502 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fa0f5155-4b39-4eb7-a5cd-f295762e8a5f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:08.198117 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fa0f5155-4b39-4eb7-a5cd-f295762e8a5f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:08.204476 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa0f5155-4b39-4eb7-a5cd-f295762e8a5f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:08.204995 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa0f5155-4b39-4eb7-a5cd-f295762e8a5f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:08.205448 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa0f5155-4b39-4eb7-a5cd-f295762e8a5f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:08.206144 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa0f5155-4b39-4eb7-a5cd-f295762e8a5f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:08.206612 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa0f5155-4b39-4eb7-a5cd-f295762e8a5f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:08.207038 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa0f5155-4b39-4eb7-a5cd-f295762e8a5f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:08.339572 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-fa0f5155-4b39-4eb7-a5cd-f295762e8a5f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:08.347263 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fa0f5155-4b39-4eb7-a5cd-f295762e8a5f tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1569 microversion: 2.1 time: 0.153750 Oct 01 04:27:08.347851 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 441/909] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:08 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:08.361024 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e523e0e9-c6fe-4eb2-96b7-308aeb5c379d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:08.361544 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e523e0e9-c6fe-4eb2-96b7-308aeb5c379d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 9c97834c-96c0-475f-90e5-f51da938482a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:08.367807 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e523e0e9-c6fe-4eb2-96b7-308aeb5c379d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:08.368286 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e523e0e9-c6fe-4eb2-96b7-308aeb5c379d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:08.368717 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e523e0e9-c6fe-4eb2-96b7-308aeb5c379d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:08.369424 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e523e0e9-c6fe-4eb2-96b7-308aeb5c379d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:08.369878 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e523e0e9-c6fe-4eb2-96b7-308aeb5c379d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:08.370300 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e523e0e9-c6fe-4eb2-96b7-308aeb5c379d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:08.392850 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e523e0e9-c6fe-4eb2-96b7-308aeb5c379d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a/ips" status: 200 len: 148 microversion: 2.1 time: 0.035459 Oct 01 04:27:08.393423 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 469/910] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 1 04:27:08 2022] GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a/ips => generated 148 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:27:08.405667 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e330ada3-fbdb-46c3-b8c3-12ec68926657 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e4fbcdf-fc98-4acc-b274-20225bbfd273"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:27:08.408090 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e330ada3-fbdb-46c3-b8c3-12ec68926657 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 9c97834c-96c0-475f-90e5-f51da938482a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:08.414560 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e330ada3-fbdb-46c3-b8c3-12ec68926657 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:08.415051 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e330ada3-fbdb-46c3-b8c3-12ec68926657 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:08.415490 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e330ada3-fbdb-46c3-b8c3-12ec68926657 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:08.416175 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e330ada3-fbdb-46c3-b8c3-12ec68926657 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:08.416633 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e330ada3-fbdb-46c3-b8c3-12ec68926657 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:08.417096 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e330ada3-fbdb-46c3-b8c3-12ec68926657 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:08.494394 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-e330ada3-fbdb-46c3-b8c3-12ec68926657 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] HTTP exception thrown: Invalid volume: volume 7e4fbcdf-fc98-4acc-b274-20225bbfd273 is already attached to instances: 7666cbd6-6648-4f0b-ba58-7a95bd94700c Oct 01 04:27:08.496108 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e330ada3-fbdb-46c3-b8c3-12ec68926657 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Request method failure captured: Oct 01 04:27:08.496108 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: request: POST /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a/os-volume_attachments HTTP/1.1 Oct 01 04:27:08.496108 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept: application/json Oct 01 04:27:08.496108 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept-Encoding: identity Oct 01 04:27:08.496108 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Connection: close Oct 01 04:27:08.496108 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Length: 74 Oct 01 04:27:08.496108 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Type: application/json Oct 01 04:27:08.496108 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Host: 10.222.0.26 Oct 01 04:27:08.496108 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 01 04:27:08.496108 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 01 04:27:08.496108 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjN8EwZiIdaSHgJefVWHSlZ0UU8OX8R0aPtB8r1Pr3nfRFZLn6johVmlyimBuO6m2htmIzgGcwibHj5pfyrNspEC0yv0MbvK2BKJDTuaMjl6PU4M8pcs1czjr2NKHPBvNTiXqfyyojseF__WWl_lh7hlPx5Xw0WdfDj8zF_1x1MH7EsUY Oct 01 04:27:08.496108 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Id: None Oct 01 04:27:08.496108 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Name: None Oct 01 04:27:08.496108 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 01 04:27:08.496108 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 01 04:27:08.496108 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 01 04:27:08.496108 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 01 04:27:08.496108 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Id: 57f927e7829a4172b9919b964a9e7c13 Oct 01 04:27:08.496108 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Name: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:27:08.496108 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Role: reader,member Oct 01 04:27:08.496108 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Roles: reader,member Oct 01 04:27:08.497825 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:27:08.497825 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:27:08.497825 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Id: 57f927e7829a4172b9919b964a9e7c13 Oct 01 04:27:08.497825 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:27:08.497825 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User: tempest-AttachVolumeNegativeTest-41085015-project Oct 01 04:27:08.497825 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 01 04:27:08.497825 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 01 04:27:08.497825 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Id: 0e30d69a25494d70bc094eb92c4f9bb0 Oct 01 04:27:08.497825 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Name: tempest-AttachVolumeNegativeTest-41085015-project Oct 01 04:27:08.497825 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Oct 01 04:27:08.497825 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {"volumeAttachment": {"volumeId": "7e4fbcdf-fc98-4acc-b274-20225bbfd273"}} Oct 01 04:27:08.497825 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: method: > Oct 01 04:27:08.498840 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: exception: Invalid volume: volume 7e4fbcdf-fc98-4acc-b274-20225bbfd273 is already attached to instances: 7666cbd6-6648-4f0b-ba58-7a95bd94700c Oct 01 04:27:08.498840 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: action_args: {'server_id': '9c97834c-96c0-475f-90e5-f51da938482a', 'body': {'volumeAttachment': {'volumeId': '7e4fbcdf-fc98-4acc-b274-20225bbfd273'}}} Oct 01 04:27:08.498840 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:27:08.498840 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:27:08.498840 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 01 04:27:08.498840 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 01 04:27:08.498840 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 01 04:27:08.498840 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 04:27:08.498840 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 01 04:27:08.498840 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 01 04:27:08.498840 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 01 04:27:08.498840 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 01 04:27:08.498840 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 01 04:27:08.498840 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 01 04:27:08.498840 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7e4fbcdf-fc98-4acc-b274-20225bbfd273 is already attached to instances: 7666cbd6-6648-4f0b-ba58-7a95bd94700c Oct 01 04:27:08.498840 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:27:08.498840 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:27:08.498840 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:27:08.498840 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:27:08.500379 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:27:08.500379 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:27:08.500379 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:27:08.500379 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:27:08.500379 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:27:08.500379 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:27:08.500379 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 04:27:08.500379 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 04:27:08.500379 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 04:27:08.500379 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 04:27:08.500379 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 04:27:08.500379 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 04:27:08.500379 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 01 04:27:08.500379 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 01 04:27:08.500379 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7e4fbcdf-fc98-4acc-b274-20225bbfd273 is already attached to instances: 7666cbd6-6648-4f0b-ba58-7a95bd94700c Oct 01 04:27:08.500379 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:27:08.500379 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:27:08.500379 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:27:08.500379 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:27:08.500379 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:27:08.506460 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:27:08.506460 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:27:08.506460 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:27:08.506460 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7e4fbcdf-fc98-4acc-b274-20225bbfd273 is already attached to instances: 7666cbd6-6648-4f0b-ba58-7a95bd94700c Oct 01 04:27:08.506460 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:27:08.506460 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e330ada3-fbdb-46c3-b8c3-12ec68926657 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Returning 400 to user: Invalid volume: volume 7e4fbcdf-fc98-4acc-b274-20225bbfd273 is already attached to instances: 7666cbd6-6648-4f0b-ba58-7a95bd94700c {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:27:08.506460 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e330ada3-fbdb-46c3-b8c3-12ec68926657 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "POST /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095865 Oct 01 04:27:08.506460 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 442/911] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 1 04:27:08 2022] POST /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 04:27:08.507632 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-76f42b6d-82bc-4e41-b1f7-ceebc2a7fc8f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:08.507632 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-76f42b6d-82bc-4e41-b1f7-ceebc2a7fc8f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 9c97834c-96c0-475f-90e5-f51da938482a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:08.513541 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76f42b6d-82bc-4e41-b1f7-ceebc2a7fc8f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:08.514025 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76f42b6d-82bc-4e41-b1f7-ceebc2a7fc8f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:08.514462 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76f42b6d-82bc-4e41-b1f7-ceebc2a7fc8f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:08.515148 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76f42b6d-82bc-4e41-b1f7-ceebc2a7fc8f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:08.515667 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76f42b6d-82bc-4e41-b1f7-ceebc2a7fc8f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:08.516034 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76f42b6d-82bc-4e41-b1f7-ceebc2a7fc8f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:08.541594 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-76f42b6d-82bc-4e41-b1f7-ceebc2a7fc8f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 9c97834c-96c0-475f-90e5-f51da938482a] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 04:27:08.614886 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-76f42b6d-82bc-4e41-b1f7-ceebc2a7fc8f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a" status: 204 len: 0 microversion: 2.1 time: 0.111992 Oct 01 04:27:08.615465 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 470/912] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 1 04:27:08 2022] DELETE /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 01 04:27:08.624101 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3e366923-d7da-4d8a-b68c-da41633f5951 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:08.624731 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3e366923-d7da-4d8a-b68c-da41633f5951 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 9c97834c-96c0-475f-90e5-f51da938482a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:08.633931 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e366923-d7da-4d8a-b68c-da41633f5951 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:08.634437 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e366923-d7da-4d8a-b68c-da41633f5951 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:08.634883 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e366923-d7da-4d8a-b68c-da41633f5951 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:08.635584 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e366923-d7da-4d8a-b68c-da41633f5951 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:08.636051 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e366923-d7da-4d8a-b68c-da41633f5951 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:08.636485 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e366923-d7da-4d8a-b68c-da41633f5951 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:08.765128 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-3e366923-d7da-4d8a-b68c-da41633f5951 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:08.773813 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3e366923-d7da-4d8a-b68c-da41633f5951 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a" status: 200 len: 1680 microversion: 2.1 time: 0.152740 Oct 01 04:27:08.774204 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 443/913] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:08 2022] GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:27:09.373621 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-25599b51-10f4-436f-9f6d-eac6bd3676df tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:09.374565 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-25599b51-10f4-436f-9f6d-eac6bd3676df tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:09.381601 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25599b51-10f4-436f-9f6d-eac6bd3676df tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:09.382147 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25599b51-10f4-436f-9f6d-eac6bd3676df tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:09.382586 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25599b51-10f4-436f-9f6d-eac6bd3676df tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:09.383363 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25599b51-10f4-436f-9f6d-eac6bd3676df tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:09.383828 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25599b51-10f4-436f-9f6d-eac6bd3676df tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:09.384251 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-25599b51-10f4-436f-9f6d-eac6bd3676df tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:09.518252 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-25599b51-10f4-436f-9f6d-eac6bd3676df tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:09.526420 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-25599b51-10f4-436f-9f6d-eac6bd3676df tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1569 microversion: 2.1 time: 0.160155 Oct 01 04:27:09.526976 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 471/914] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:09 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:09.797806 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0930301f-736f-48d5-b9c3-b459365a12e4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:09.798370 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0930301f-736f-48d5-b9c3-b459365a12e4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 9c97834c-96c0-475f-90e5-f51da938482a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:09.805008 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0930301f-736f-48d5-b9c3-b459365a12e4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:09.805501 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0930301f-736f-48d5-b9c3-b459365a12e4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:09.805945 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0930301f-736f-48d5-b9c3-b459365a12e4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:09.806648 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0930301f-736f-48d5-b9c3-b459365a12e4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:09.807111 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0930301f-736f-48d5-b9c3-b459365a12e4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:09.807542 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0930301f-736f-48d5-b9c3-b459365a12e4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:09.935530 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-0930301f-736f-48d5-b9c3-b459365a12e4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:09.943093 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0930301f-736f-48d5-b9c3-b459365a12e4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a" status: 200 len: 1680 microversion: 2.1 time: 0.149231 Oct 01 04:27:09.943654 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 444/915] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:09 2022] GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:10.551891 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-86925b76-1e1b-4cad-bab7-6140d005e8c4 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:10.553769 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-86925b76-1e1b-4cad-bab7-6140d005e8c4 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:10.561283 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86925b76-1e1b-4cad-bab7-6140d005e8c4 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:10.561766 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86925b76-1e1b-4cad-bab7-6140d005e8c4 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:10.562198 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86925b76-1e1b-4cad-bab7-6140d005e8c4 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:10.562891 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86925b76-1e1b-4cad-bab7-6140d005e8c4 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:10.563344 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86925b76-1e1b-4cad-bab7-6140d005e8c4 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:10.563763 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86925b76-1e1b-4cad-bab7-6140d005e8c4 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:10.698054 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-86925b76-1e1b-4cad-bab7-6140d005e8c4 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:10.706317 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-86925b76-1e1b-4cad-bab7-6140d005e8c4 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1569 microversion: 2.1 time: 0.159863 Oct 01 04:27:10.706884 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 472/916] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:10 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:10.973336 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7af800f8-9c8c-4a1b-9587-2b04b1edda36 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:10.974910 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7af800f8-9c8c-4a1b-9587-2b04b1edda36 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 9c97834c-96c0-475f-90e5-f51da938482a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:10.982898 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7af800f8-9c8c-4a1b-9587-2b04b1edda36 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:10.983734 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7af800f8-9c8c-4a1b-9587-2b04b1edda36 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:10.984520 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7af800f8-9c8c-4a1b-9587-2b04b1edda36 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:10.985516 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7af800f8-9c8c-4a1b-9587-2b04b1edda36 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:10.986175 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7af800f8-9c8c-4a1b-9587-2b04b1edda36 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:10.986792 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7af800f8-9c8c-4a1b-9587-2b04b1edda36 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:11.060840 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-7af800f8-9c8c-4a1b-9587-2b04b1edda36 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:11.068618 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7af800f8-9c8c-4a1b-9587-2b04b1edda36 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a" status: 200 len: 1612 microversion: 2.1 time: 0.103179 Oct 01 04:27:11.069979 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 445/917] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:10 2022] GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a => generated 1612 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:11.094429 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-2a1d8661-2d70-4448-bc1e-531d3199ea92 req-91c42740-ad65-4af5-b803-917108c5e988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c97834c-96c0-475f-90e5-f51da938482a", "name": "network-vif-deleted", "tag": "d2f63b7f-13d5-4488-afdf-ac0c1ff404e5"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:27:11.115654 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2a1d8661-2d70-4448-bc1e-531d3199ea92 req-91c42740-ad65-4af5-b803-917108c5e988 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:11.117277 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2a1d8661-2d70-4448-bc1e-531d3199ea92 req-91c42740-ad65-4af5-b803-917108c5e988 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:11.117811 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-2a1d8661-2d70-4448-bc1e-531d3199ea92 req-91c42740-ad65-4af5-b803-917108c5e988 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:11.129216 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-2a1d8661-2d70-4448-bc1e-531d3199ea92 req-91c42740-ad65-4af5-b803-917108c5e988 service nova] Creating event network-vif-deleted:d2f63b7f-13d5-4488-afdf-ac0c1ff404e5 for instance 9c97834c-96c0-475f-90e5-f51da938482a on hv-cinder-86004 Oct 01 04:27:11.134523 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-2a1d8661-2d70-4448-bc1e-531d3199ea92 req-91c42740-ad65-4af5-b803-917108c5e988 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044033 Oct 01 04:27:11.135274 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 473/918] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:27:11.729012 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-76c372c5-1650-4de7-9db8-4ad083513a96 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:11.729665 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-76c372c5-1650-4de7-9db8-4ad083513a96 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:11.736123 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76c372c5-1650-4de7-9db8-4ad083513a96 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:11.736635 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76c372c5-1650-4de7-9db8-4ad083513a96 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:11.737133 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76c372c5-1650-4de7-9db8-4ad083513a96 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:11.737851 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76c372c5-1650-4de7-9db8-4ad083513a96 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:11.738325 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76c372c5-1650-4de7-9db8-4ad083513a96 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:11.739593 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-76c372c5-1650-4de7-9db8-4ad083513a96 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:11.912190 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-76c372c5-1650-4de7-9db8-4ad083513a96 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:11.920831 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-76c372c5-1650-4de7-9db8-4ad083513a96 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1569 microversion: 2.1 time: 0.196075 Oct 01 04:27:11.921460 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 446/919] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:11 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1569 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:12.093966 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fda19102-d690-4d05-919d-383eaa7f7e11 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:12.094777 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-fda19102-d690-4d05-919d-383eaa7f7e11 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 9c97834c-96c0-475f-90e5-f51da938482a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:12.101075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fda19102-d690-4d05-919d-383eaa7f7e11 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:12.101671 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fda19102-d690-4d05-919d-383eaa7f7e11 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:12.102223 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fda19102-d690-4d05-919d-383eaa7f7e11 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:12.103223 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fda19102-d690-4d05-919d-383eaa7f7e11 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:12.103752 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fda19102-d690-4d05-919d-383eaa7f7e11 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:12.104182 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-fda19102-d690-4d05-919d-383eaa7f7e11 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:12.118371 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-fda19102-d690-4d05-919d-383eaa7f7e11 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] HTTP exception thrown: Instance 9c97834c-96c0-475f-90e5-f51da938482a could not be found. Oct 01 04:27:12.120294 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fda19102-d690-4d05-919d-383eaa7f7e11 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Request method failure captured: Oct 01 04:27:12.120294 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a HTTP/1.1 Oct 01 04:27:12.120294 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:27:12.120294 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:27:12.120294 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:27:12.120294 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 0 Oct 01 04:27:12.120294 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:27:12.120294 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:27:12.120294 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:27:12.120294 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:27:12.120294 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN8EwZiIdaSHgJefVWHSlZ0UU8OX8R0aPtB8r1Pr3nfRFZLn6johVmlyimBuO6m2htmIzgGcwibHj5pfyrNspEC0yv0MbvK2BKJDTuaMjl6PU4M8pcs1czjr2NKHPBvNTiXqfyyojseF__WWl_lh7hlPx5Xw0WdfDj8zF_1x1MH7EsUY Oct 01 04:27:12.120294 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:27:12.120294 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:27:12.120294 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:27:12.120294 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:27:12.120294 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:27:12.120294 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:27:12.120294 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: 57f927e7829a4172b9919b964a9e7c13 Oct 01 04:27:12.120294 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:27:12.120294 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:27:12.120294 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:27:12.121929 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:27:12.121929 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:27:12.121929 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 57f927e7829a4172b9919b964a9e7c13 Oct 01 04:27:12.121929 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:27:12.121929 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-AttachVolumeNegativeTest-41085015-project Oct 01 04:27:12.121929 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:27:12.121929 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:27:12.121929 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: 0e30d69a25494d70bc094eb92c4f9bb0 Oct 01 04:27:12.121929 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeNegativeTest-41085015-project Oct 01 04:27:12.121929 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: > Oct 01 04:27:12.121929 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Instance 9c97834c-96c0-475f-90e5-f51da938482a could not be found. Oct 01 04:27:12.121929 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'id': '9c97834c-96c0-475f-90e5-f51da938482a'} Oct 01 04:27:12.122782 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:27:12.122782 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:27:12.122782 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:27:12.122782 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:27:12.122782 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:27:12.122782 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:27:12.122782 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:27:12.122782 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:27:12.122782 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:27:12.122782 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:27:12.122782 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c97834c-96c0-475f-90e5-f51da938482a could not be found. Oct 01 04:27:12.122782 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:27:12.122782 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:27:12.122782 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:27:12.122782 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:27:12.122782 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:27:12.122782 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:27:12.122782 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:27:12.122782 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:27:12.122782 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:27:12.124288 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:27:12.124288 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:27:12.124288 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:27:12.124288 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:27:12.124288 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:27:12.124288 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:27:12.124288 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:27:12.124288 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c97834c-96c0-475f-90e5-f51da938482a could not be found. Oct 01 04:27:12.124288 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:27:12.124288 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:27:12.124288 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:27:12.124288 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:27:12.124288 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:27:12.124288 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:27:12.124288 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:27:12.124288 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:27:12.124288 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c97834c-96c0-475f-90e5-f51da938482a could not be found. Oct 01 04:27:12.124288 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:27:12.125756 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-fda19102-d690-4d05-919d-383eaa7f7e11 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Returning 404 to user: Instance 9c97834c-96c0-475f-90e5-f51da938482a could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:27:12.125756 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-fda19102-d690-4d05-919d-383eaa7f7e11 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a" status: 404 len: 111 microversion: 2.1 time: 0.032423 Oct 01 04:27:12.125756 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 474/920] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:12 2022] GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:27:12.130966 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e4522a75-99db-4367-be83-c7e473afcf12 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '.version_select at 0x7fdfbe8a6e50>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:12.150859 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e4522a75-99db-4367-be83-c7e473afcf12 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2136203695" status: 202 len: 0 microversion: 2.1 time: 0.023677 Oct 01 04:27:12.151423 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 447/921] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 1 04:27:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2136203695 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 04:27:12.799064 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-291f714f-cb38-4f5d-aa86-651ac79f7f76 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:12.799560 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-291f714f-cb38-4f5d-aa86-651ac79f7f76 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 7666cbd6-6648-4f0b-ba58-7a95bd94700c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:12.805683 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-291f714f-cb38-4f5d-aa86-651ac79f7f76 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:12.806193 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-291f714f-cb38-4f5d-aa86-651ac79f7f76 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:12.806631 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-291f714f-cb38-4f5d-aa86-651ac79f7f76 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:12.807324 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-291f714f-cb38-4f5d-aa86-651ac79f7f76 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:12.807785 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-291f714f-cb38-4f5d-aa86-651ac79f7f76 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:12.808211 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-291f714f-cb38-4f5d-aa86-651ac79f7f76 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:12.888783 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-291f714f-cb38-4f5d-aa86-651ac79f7f76 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lazy-loading 'services' on Instance uuid 7666cbd6-6648-4f0b-ba58-7a95bd94700c {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:27:12.946879 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4d97c3cb-6f4c-40e7-8c98-8f67149457b6 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:12.947532 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4d97c3cb-6f4c-40e7-8c98-8f67149457b6 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:12.954615 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d97c3cb-6f4c-40e7-8c98-8f67149457b6 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:12.955163 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d97c3cb-6f4c-40e7-8c98-8f67149457b6 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:12.955607 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d97c3cb-6f4c-40e7-8c98-8f67149457b6 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:12.956310 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d97c3cb-6f4c-40e7-8c98-8f67149457b6 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:12.956799 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d97c3cb-6f4c-40e7-8c98-8f67149457b6 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:12.957445 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4d97c3cb-6f4c-40e7-8c98-8f67149457b6 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:12.964453 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-291f714f-cb38-4f5d-aa86-651ac79f7f76 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c/os-volume_attachments/7e4fbcdf-fc98-4acc-b274-20225bbfd273" status: 202 len: 0 microversion: 2.1 time: 0.169104 Oct 01 04:27:12.965257 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 475/922] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 1 04:27:12 2022] DELETE /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c/os-volume_attachments/7e4fbcdf-fc98-4acc-b274-20225bbfd273 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 04:27:12.974022 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e3cbb03a-ba98-4a0f-b8ba-8233fd32ad41 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:12.976326 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e3cbb03a-ba98-4a0f-b8ba-8233fd32ad41 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 7666cbd6-6648-4f0b-ba58-7a95bd94700c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:12.983112 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e3cbb03a-ba98-4a0f-b8ba-8233fd32ad41 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:12.983549 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e3cbb03a-ba98-4a0f-b8ba-8233fd32ad41 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:12.983998 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e3cbb03a-ba98-4a0f-b8ba-8233fd32ad41 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:12.984704 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e3cbb03a-ba98-4a0f-b8ba-8233fd32ad41 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:12.985199 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e3cbb03a-ba98-4a0f-b8ba-8233fd32ad41 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:12.985636 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e3cbb03a-ba98-4a0f-b8ba-8233fd32ad41 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:13.015909 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e3cbb03a-ba98-4a0f-b8ba-8233fd32ad41 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046084 Oct 01 04:27:13.016476 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 476/923] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 1 04:27:12 2022] GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:27:13.089758 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-4d97c3cb-6f4c-40e7-8c98-8f67149457b6 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:13.097448 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4d97c3cb-6f4c-40e7-8c98-8f67149457b6 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1569 microversion: 2.1 time: 0.155220 Oct 01 04:27:13.098136 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 448/924] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:12 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:27:14.029747 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-716415d0-aac7-4852-b474-493c356ddd3b tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:14.032114 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-716415d0-aac7-4852-b474-493c356ddd3b tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 7666cbd6-6648-4f0b-ba58-7a95bd94700c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:14.040077 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-716415d0-aac7-4852-b474-493c356ddd3b tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:14.040675 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-716415d0-aac7-4852-b474-493c356ddd3b tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:14.041157 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-716415d0-aac7-4852-b474-493c356ddd3b tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:14.041855 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-716415d0-aac7-4852-b474-493c356ddd3b tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:14.042312 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-716415d0-aac7-4852-b474-493c356ddd3b tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:14.042758 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-716415d0-aac7-4852-b474-493c356ddd3b tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:14.077283 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-716415d0-aac7-4852-b474-493c356ddd3b tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052609 Oct 01 04:27:14.078113 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 477/925] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 1 04:27:14 2022] GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:27:14.123104 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b8425855-14df-4edc-830d-11e024f1d690 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:14.124728 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b8425855-14df-4edc-830d-11e024f1d690 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:14.130876 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8425855-14df-4edc-830d-11e024f1d690 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:14.131368 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8425855-14df-4edc-830d-11e024f1d690 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:14.131806 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8425855-14df-4edc-830d-11e024f1d690 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:14.132491 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8425855-14df-4edc-830d-11e024f1d690 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:14.133115 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8425855-14df-4edc-830d-11e024f1d690 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:14.134132 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b8425855-14df-4edc-830d-11e024f1d690 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:14.269130 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-b8425855-14df-4edc-830d-11e024f1d690 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:14.276995 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b8425855-14df-4edc-830d-11e024f1d690 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1569 microversion: 2.1 time: 0.159473 Oct 01 04:27:14.277487 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 449/926] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:14 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:15.090559 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-29c346ff-af3c-4413-ba49-22379d890f5f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:15.092946 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-29c346ff-af3c-4413-ba49-22379d890f5f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 7666cbd6-6648-4f0b-ba58-7a95bd94700c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:15.099667 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29c346ff-af3c-4413-ba49-22379d890f5f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:15.100151 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29c346ff-af3c-4413-ba49-22379d890f5f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:15.100592 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29c346ff-af3c-4413-ba49-22379d890f5f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:15.101319 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29c346ff-af3c-4413-ba49-22379d890f5f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:15.101773 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29c346ff-af3c-4413-ba49-22379d890f5f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:15.102195 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-29c346ff-af3c-4413-ba49-22379d890f5f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:15.127658 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:27:15.132285 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-29c346ff-af3c-4413-ba49-22379d890f5f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046332 Oct 01 04:27:15.132833 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 478/927] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 1 04:27:15 2022] GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 04:27:15.196509 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6609061f-bbf2-45f0-8dcc-8caecb81ef6d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:15.197638 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6609061f-bbf2-45f0-8dcc-8caecb81ef6d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 7666cbd6-6648-4f0b-ba58-7a95bd94700c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:15.204202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6609061f-bbf2-45f0-8dcc-8caecb81ef6d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:15.204722 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6609061f-bbf2-45f0-8dcc-8caecb81ef6d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:15.205194 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6609061f-bbf2-45f0-8dcc-8caecb81ef6d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:15.205895 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6609061f-bbf2-45f0-8dcc-8caecb81ef6d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:15.206355 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6609061f-bbf2-45f0-8dcc-8caecb81ef6d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:15.206785 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6609061f-bbf2-45f0-8dcc-8caecb81ef6d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:15.233161 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6609061f-bbf2-45f0-8dcc-8caecb81ef6d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 7666cbd6-6648-4f0b-ba58-7a95bd94700c] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 04:27:15.299809 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7393a37d-0ccc-4530-8a51-3df4dd0f574b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:15.300449 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7393a37d-0ccc-4530-8a51-3df4dd0f574b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:15.307956 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7393a37d-0ccc-4530-8a51-3df4dd0f574b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:15.308711 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7393a37d-0ccc-4530-8a51-3df4dd0f574b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:15.309366 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7393a37d-0ccc-4530-8a51-3df4dd0f574b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:15.310054 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7393a37d-0ccc-4530-8a51-3df4dd0f574b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:15.310509 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7393a37d-0ccc-4530-8a51-3df4dd0f574b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:15.310960 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7393a37d-0ccc-4530-8a51-3df4dd0f574b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:15.311156 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6609061f-bbf2-45f0-8dcc-8caecb81ef6d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c" status: 204 len: 0 microversion: 2.1 time: 0.117585 Oct 01 04:27:15.311720 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 450/928] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 1 04:27:15 2022] DELETE /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 04:27:15.320853 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a076e630-7fd7-4eaf-bca3-20346b0f5f92 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:15.321576 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a076e630-7fd7-4eaf-bca3-20346b0f5f92 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 7666cbd6-6648-4f0b-ba58-7a95bd94700c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:15.328378 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a076e630-7fd7-4eaf-bca3-20346b0f5f92 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:15.328963 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a076e630-7fd7-4eaf-bca3-20346b0f5f92 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:15.329362 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a076e630-7fd7-4eaf-bca3-20346b0f5f92 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:15.330063 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a076e630-7fd7-4eaf-bca3-20346b0f5f92 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:15.330526 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a076e630-7fd7-4eaf-bca3-20346b0f5f92 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:15.330955 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a076e630-7fd7-4eaf-bca3-20346b0f5f92 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:15.503566 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7393a37d-0ccc-4530-8a51-3df4dd0f574b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:15.512356 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7393a37d-0ccc-4530-8a51-3df4dd0f574b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1510 microversion: 2.1 time: 0.216334 Oct 01 04:27:15.512969 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 479/929] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:15 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1510 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:27:15.516421 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-a076e630-7fd7-4eaf-bca3-20346b0f5f92 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:15.525795 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a076e630-7fd7-4eaf-bca3-20346b0f5f92 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c" status: 200 len: 1680 microversion: 2.1 time: 0.208677 Oct 01 04:27:15.526475 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 451/930] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:15 2022] GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c => generated 1680 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:27:15.535499 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-78f37001-3c31-48ec-abc4-177cf7dfee9e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:27:15.536102 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-78f37001-3c31-48ec-abc4-177cf7dfee9e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:15.542384 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78f37001-3c31-48ec-abc4-177cf7dfee9e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:15.542904 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78f37001-3c31-48ec-abc4-177cf7dfee9e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:15.543344 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78f37001-3c31-48ec-abc4-177cf7dfee9e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:15.544035 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78f37001-3c31-48ec-abc4-177cf7dfee9e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:15.544496 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78f37001-3c31-48ec-abc4-177cf7dfee9e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:15.544945 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-78f37001-3c31-48ec-abc4-177cf7dfee9e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:15.574577 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-78f37001-3c31-48ec-abc4-177cf7dfee9e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120598) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 01 04:27:15.638848 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-78f37001-3c31-48ec-abc4-177cf7dfee9e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "POST /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d/action" status: 202 len: 0 microversion: 2.1 time: 0.107086 Oct 01 04:27:15.639369 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 480/931] 10.222.0.26 () {60 vars in 1278 bytes} [Sat Oct 1 04:27:15 2022] POST /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 04:27:15.647665 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f273d5f5-d649-47e7-a595-327a5ce3b543 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:15.648283 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f273d5f5-d649-47e7-a595-327a5ce3b543 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:15.654646 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f273d5f5-d649-47e7-a595-327a5ce3b543 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:15.655142 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f273d5f5-d649-47e7-a595-327a5ce3b543 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:15.655580 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f273d5f5-d649-47e7-a595-327a5ce3b543 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:15.656281 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f273d5f5-d649-47e7-a595-327a5ce3b543 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:15.656743 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f273d5f5-d649-47e7-a595-327a5ce3b543 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:15.657200 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f273d5f5-d649-47e7-a595-327a5ce3b543 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:15.842926 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-f273d5f5-d649-47e7-a595-327a5ce3b543 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:15.850702 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f273d5f5-d649-47e7-a595-327a5ce3b543 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1518 microversion: 2.1 time: 0.206871 Oct 01 04:27:15.851342 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 452/932] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:15 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1518 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:27:16.550295 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-7a566ab6-5b28-439a-a295-36fed51863a5 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:16.550877 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-7a566ab6-5b28-439a-a295-36fed51863a5 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 7666cbd6-6648-4f0b-ba58-7a95bd94700c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:16.557035 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a566ab6-5b28-439a-a295-36fed51863a5 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:16.557528 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a566ab6-5b28-439a-a295-36fed51863a5 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:16.557979 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a566ab6-5b28-439a-a295-36fed51863a5 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:16.558679 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a566ab6-5b28-439a-a295-36fed51863a5 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:16.559142 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a566ab6-5b28-439a-a295-36fed51863a5 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:16.559571 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-7a566ab6-5b28-439a-a295-36fed51863a5 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:16.698981 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-7a566ab6-5b28-439a-a295-36fed51863a5 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:16.706690 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-7a566ab6-5b28-439a-a295-36fed51863a5 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c" status: 200 len: 1680 microversion: 2.1 time: 0.160825 Oct 01 04:27:16.707256 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 481/933] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:16 2022] GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:16.874446 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-22c9e5eb-6ca5-4f0d-93ad-49f256b0c37a tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:16.875705 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-22c9e5eb-6ca5-4f0d-93ad-49f256b0c37a tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:16.894714 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22c9e5eb-6ca5-4f0d-93ad-49f256b0c37a tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:16.905551 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22c9e5eb-6ca5-4f0d-93ad-49f256b0c37a tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:16.906084 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22c9e5eb-6ca5-4f0d-93ad-49f256b0c37a tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:16.906901 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22c9e5eb-6ca5-4f0d-93ad-49f256b0c37a tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:16.907461 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22c9e5eb-6ca5-4f0d-93ad-49f256b0c37a tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:16.908130 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-22c9e5eb-6ca5-4f0d-93ad-49f256b0c37a tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:16.958958 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-748e0224-3e0a-4f5a-bbe0-36a72622641e req-df33cb0d-ca3f-4bf2-bf7b-ecd851524929 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af93c94-483f-4f6d-a017-d45ef01bac8d", "name": "network-vif-unplugged", "status": "completed", "tag": "ff800efd-217a-4aea-84a5-e5f05dd17b62"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:27:16.972320 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-748e0224-3e0a-4f5a-bbe0-36a72622641e req-df33cb0d-ca3f-4bf2-bf7b-ecd851524929 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:16.972727 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-748e0224-3e0a-4f5a-bbe0-36a72622641e req-df33cb0d-ca3f-4bf2-bf7b-ecd851524929 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:16.973633 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-748e0224-3e0a-4f5a-bbe0-36a72622641e req-df33cb0d-ca3f-4bf2-bf7b-ecd851524929 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:16.987108 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.compute.server_external_events [req-748e0224-3e0a-4f5a-bbe0-36a72622641e req-df33cb0d-ca3f-4bf2-bf7b-ecd851524929 service nova] Unable to find a host for instance 2af93c94-483f-4f6d-a017-d45ef01bac8d. Dropping event network-vif-unplugged {{(pid=120598) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 01 04:27:16.988254 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-748e0224-3e0a-4f5a-bbe0-36a72622641e req-df33cb0d-ca3f-4bf2-bf7b-ecd851524929 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034077 Oct 01 04:27:16.989186 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 482/934] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 01 04:27:17.059162 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-22c9e5eb-6ca5-4f0d-93ad-49f256b0c37a tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:17.062705 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:27:17.068082 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-22c9e5eb-6ca5-4f0d-93ad-49f256b0c37a tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1520 microversion: 2.1 time: 0.197728 Oct 01 04:27:17.068645 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 453/935] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:16 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:17.731339 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f88b0f1e-da55-4684-a158-c73592265867 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:17.731910 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f88b0f1e-da55-4684-a158-c73592265867 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 7666cbd6-6648-4f0b-ba58-7a95bd94700c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:17.745522 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f88b0f1e-da55-4684-a158-c73592265867 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:17.745522 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f88b0f1e-da55-4684-a158-c73592265867 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:17.745919 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f88b0f1e-da55-4684-a158-c73592265867 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:17.746651 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f88b0f1e-da55-4684-a158-c73592265867 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:17.747116 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f88b0f1e-da55-4684-a158-c73592265867 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:17.747548 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f88b0f1e-da55-4684-a158-c73592265867 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:17.800622 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-50d9026d-ab4c-44f4-b3d4-9c3a151533e8 req-2864bd8f-da8f-498f-bc5f-9d960b404d4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7666cbd6-6648-4f0b-ba58-7a95bd94700c", "name": "network-vif-deleted", "tag": "6050285d-4ac5-4514-991a-d2765dc0ca76"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:27:17.812733 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-50d9026d-ab4c-44f4-b3d4-9c3a151533e8 req-2864bd8f-da8f-498f-bc5f-9d960b404d4a service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:17.813294 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-50d9026d-ab4c-44f4-b3d4-9c3a151533e8 req-2864bd8f-da8f-498f-bc5f-9d960b404d4a service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:17.813925 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-50d9026d-ab4c-44f4-b3d4-9c3a151533e8 req-2864bd8f-da8f-498f-bc5f-9d960b404d4a service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:17.816818 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f88b0f1e-da55-4684-a158-c73592265867 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:17.826950 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f88b0f1e-da55-4684-a158-c73592265867 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c" status: 200 len: 1612 microversion: 2.1 time: 0.100097 Oct 01 04:27:17.828109 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 483/936] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:17 2022] GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c => generated 1612 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:17.830354 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-50d9026d-ab4c-44f4-b3d4-9c3a151533e8 req-2864bd8f-da8f-498f-bc5f-9d960b404d4a service nova] Creating event network-vif-deleted:6050285d-4ac5-4514-991a-d2765dc0ca76 for instance 7666cbd6-6648-4f0b-ba58-7a95bd94700c on hv-cinder-86004 Oct 01 04:27:17.850756 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-50d9026d-ab4c-44f4-b3d4-9c3a151533e8 req-2864bd8f-da8f-498f-bc5f-9d960b404d4a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054573 Oct 01 04:27:17.855558 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 454/937] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:27:18.093540 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-26c50ebd-91b1-4574-a14b-ae7484b18537 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:18.094144 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-26c50ebd-91b1-4574-a14b-ae7484b18537 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:18.106186 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26c50ebd-91b1-4574-a14b-ae7484b18537 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:18.107486 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26c50ebd-91b1-4574-a14b-ae7484b18537 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:18.108135 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26c50ebd-91b1-4574-a14b-ae7484b18537 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:18.109343 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26c50ebd-91b1-4574-a14b-ae7484b18537 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:18.110228 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26c50ebd-91b1-4574-a14b-ae7484b18537 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:18.110856 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-26c50ebd-91b1-4574-a14b-ae7484b18537 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:18.268100 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-26c50ebd-91b1-4574-a14b-ae7484b18537 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:18.277274 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-26c50ebd-91b1-4574-a14b-ae7484b18537 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1576 microversion: 2.1 time: 0.188414 Oct 01 04:27:18.277870 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 484/938] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:18 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1576 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:18.856424 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-14fc434f-ca7e-41b9-bc78-729e1cdc1a89 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:18.857242 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-14fc434f-ca7e-41b9-bc78-729e1cdc1a89 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 7666cbd6-6648-4f0b-ba58-7a95bd94700c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:18.865529 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14fc434f-ca7e-41b9-bc78-729e1cdc1a89 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:18.866020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14fc434f-ca7e-41b9-bc78-729e1cdc1a89 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:18.866471 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14fc434f-ca7e-41b9-bc78-729e1cdc1a89 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:18.867158 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14fc434f-ca7e-41b9-bc78-729e1cdc1a89 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:18.867616 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14fc434f-ca7e-41b9-bc78-729e1cdc1a89 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:18.868039 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-14fc434f-ca7e-41b9-bc78-729e1cdc1a89 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:18.882338 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-14fc434f-ca7e-41b9-bc78-729e1cdc1a89 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] HTTP exception thrown: Instance 7666cbd6-6648-4f0b-ba58-7a95bd94700c could not be found. Oct 01 04:27:18.884020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-14fc434f-ca7e-41b9-bc78-729e1cdc1a89 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Request method failure captured: Oct 01 04:27:18.884020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c HTTP/1.1 Oct 01 04:27:18.884020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept: application/json Oct 01 04:27:18.884020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept-Encoding: identity Oct 01 04:27:18.884020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Connection: close Oct 01 04:27:18.884020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Length: 0 Oct 01 04:27:18.884020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Type: application/json Oct 01 04:27:18.884020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Host: 10.222.0.26 Oct 01 04:27:18.884020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 01 04:27:18.884020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 01 04:27:18.884020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjN8EwZiIdaSHgJefVWHSlZ0UU8OX8R0aPtB8r1Pr3nfRFZLn6johVmlyimBuO6m2htmIzgGcwibHj5pfyrNspEC0yv0MbvK2BKJDTuaMjl6PU4M8pcs1czjr2NKHPBvNTiXqfyyojseF__WWl_lh7hlPx5Xw0WdfDj8zF_1x1MH7EsUY Oct 01 04:27:18.884020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Id: None Oct 01 04:27:18.884020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Name: None Oct 01 04:27:18.884020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 01 04:27:18.884020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 01 04:27:18.884020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 01 04:27:18.884020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 01 04:27:18.884020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Id: 57f927e7829a4172b9919b964a9e7c13 Oct 01 04:27:18.884020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Name: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:27:18.884020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Role: reader,member Oct 01 04:27:18.884020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Roles: reader,member Oct 01 04:27:18.886157 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:27:18.886157 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:27:18.886157 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Id: 57f927e7829a4172b9919b964a9e7c13 Oct 01 04:27:18.886157 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:27:18.886157 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User: tempest-AttachVolumeNegativeTest-41085015-project Oct 01 04:27:18.886157 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 01 04:27:18.886157 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 01 04:27:18.886157 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Id: 0e30d69a25494d70bc094eb92c4f9bb0 Oct 01 04:27:18.886157 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Name: tempest-AttachVolumeNegativeTest-41085015-project Oct 01 04:27:18.886157 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: method: > Oct 01 04:27:18.886157 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: exception: Instance 7666cbd6-6648-4f0b-ba58-7a95bd94700c could not be found. Oct 01 04:27:18.886157 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: action_args: {'id': '7666cbd6-6648-4f0b-ba58-7a95bd94700c'} Oct 01 04:27:18.886950 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:27:18.886950 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:27:18.886950 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:27:18.886950 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:27:18.886950 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:27:18.886950 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:27:18.886950 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:27:18.886950 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:27:18.886950 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:27:18.886950 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:27:18.886950 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7666cbd6-6648-4f0b-ba58-7a95bd94700c could not be found. Oct 01 04:27:18.886950 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:27:18.886950 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:27:18.886950 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:27:18.886950 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:27:18.886950 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:27:18.886950 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:27:18.886950 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:27:18.886950 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:27:18.886950 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:27:18.888182 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:27:18.888182 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:27:18.888182 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:27:18.888182 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:27:18.888182 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:27:18.888182 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:27:18.888182 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:27:18.888182 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7666cbd6-6648-4f0b-ba58-7a95bd94700c could not be found. Oct 01 04:27:18.888182 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:27:18.888182 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:27:18.888182 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:27:18.888182 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:27:18.888182 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:27:18.888182 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:27:18.888182 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:27:18.888182 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:27:18.888182 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7666cbd6-6648-4f0b-ba58-7a95bd94700c could not be found. Oct 01 04:27:18.888182 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:27:18.889338 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-14fc434f-ca7e-41b9-bc78-729e1cdc1a89 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Returning 404 to user: Instance 7666cbd6-6648-4f0b-ba58-7a95bd94700c could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:27:18.889338 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-14fc434f-ca7e-41b9-bc78-729e1cdc1a89 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c" status: 404 len: 111 microversion: 2.1 time: 0.034110 Oct 01 04:27:18.889338 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 455/939] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:18 2022] GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:27:18.895355 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1f9b0753-c229-4c1b-831f-aba8abf00009 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '.version_select at 0x7fdfbe6b1dc0>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:18.913303 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1f9b0753-c229-4c1b-831f-aba8abf00009 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1867061793" status: 202 len: 0 microversion: 2.1 time: 0.021843 Oct 01 04:27:18.913876 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 485/940] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 1 04:27:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1867061793 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 04:27:19.300162 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-392cfc35-7d8d-47e4-9126-a5916df5fc5b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:19.300783 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-392cfc35-7d8d-47e4-9126-a5916df5fc5b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:19.307304 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-392cfc35-7d8d-47e4-9126-a5916df5fc5b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:19.307722 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-392cfc35-7d8d-47e4-9126-a5916df5fc5b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:19.308157 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-392cfc35-7d8d-47e4-9126-a5916df5fc5b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:19.308854 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-392cfc35-7d8d-47e4-9126-a5916df5fc5b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:19.309341 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-392cfc35-7d8d-47e4-9126-a5916df5fc5b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:19.309766 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-392cfc35-7d8d-47e4-9126-a5916df5fc5b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:19.443946 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-392cfc35-7d8d-47e4-9126-a5916df5fc5b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:19.452134 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-392cfc35-7d8d-47e4-9126-a5916df5fc5b tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1576 microversion: 2.1 time: 0.155719 Oct 01 04:27:19.453187 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 456/941] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:19 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:19.540198 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e5411172-a7ff-42cf-8a23-680bbdcad117 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Action: 'create', calling method: .version_select at 0x7fdfc2196670>, body: {"keypair": {"name": "tempest-keypair-247447907", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVkwnLEhkOl5GsW+cU81GQOsmxh5n3VGWMvjno28oek7cfWqyzK+0XeInqbfjag5mTUYCCgiQqY1NcsnODF14Ycat2jo3zx4GLW4gq3BJPoxfBRdMicYI0Cgw2PD252aQ=="}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:27:19.556730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-e5411172-a7ff-42cf-8a23-680bbdcad117 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Getting quotas for project 57f927e7829a4172b9919b964a9e7c13. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:27:19.560778 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-e5411172-a7ff-42cf-8a23-680bbdcad117 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Getting quotas for user 0e30d69a25494d70bc094eb92c4f9bb0 and project 57f927e7829a4172b9919b964a9e7c13. Resources: {'key_pairs'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:27:19.583226 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e5411172-a7ff-42cf-8a23-680bbdcad117 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047222 Oct 01 04:27:19.583802 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 486/942] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 1 04:27:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:27:20.475902 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-67040a45-c718-4a1e-93a3-c0f92877314e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:20.476516 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-67040a45-c718-4a1e-93a3-c0f92877314e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:20.483224 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67040a45-c718-4a1e-93a3-c0f92877314e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:20.483711 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67040a45-c718-4a1e-93a3-c0f92877314e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:20.484145 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67040a45-c718-4a1e-93a3-c0f92877314e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:20.484843 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67040a45-c718-4a1e-93a3-c0f92877314e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:20.485329 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67040a45-c718-4a1e-93a3-c0f92877314e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:20.485756 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-67040a45-c718-4a1e-93a3-c0f92877314e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:20.616150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-67040a45-c718-4a1e-93a3-c0f92877314e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:20.623928 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-67040a45-c718-4a1e-93a3-c0f92877314e tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1576 microversion: 2.1 time: 0.151926 Oct 01 04:27:20.624485 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 457/943] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:20 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:20.776131 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0f6f8306-715f-42c6-8dfc-93064e21743d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1840984402", "imageRef": "c63d52d7-4e3d-40cf-a8b5-59a2d027d793", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bddd7754-f392-4f22-b92b-c088917d60a6"}], "security_groups": [{"name": "tempest-securitygroup--470339029"}], "key_name": "tempest-keypair-247447907", "user_data": "}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:27:20.877222 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-0f6f8306-715f-42c6-8dfc-93064e21743d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] validate_networks() for [('bddd7754-f392-4f22-b92b-c088917d60a6', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 04:27:21.239965 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-0f6f8306-715f-42c6-8dfc-93064e21743d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 04:27:21.240411 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-0f6f8306-715f-42c6-8dfc-93064e21743d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 04:27:21.240882 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-0f6f8306-715f-42c6-8dfc-93064e21743d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 04:27:21.241359 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-0f6f8306-715f-42c6-8dfc-93064e21743d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 04:27:21.241767 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-0f6f8306-715f-42c6-8dfc-93064e21743d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 04:27:21.250359 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f6f8306-715f-42c6-8dfc-93064e21743d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:21.250835 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f6f8306-715f-42c6-8dfc-93064e21743d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:21.251281 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f6f8306-715f-42c6-8dfc-93064e21743d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:21.251983 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f6f8306-715f-42c6-8dfc-93064e21743d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:21.252434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f6f8306-715f-42c6-8dfc-93064e21743d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:21.252854 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0f6f8306-715f-42c6-8dfc-93064e21743d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:21.269625 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-0f6f8306-715f-42c6-8dfc-93064e21743d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Getting quotas for project 57f927e7829a4172b9919b964a9e7c13. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:27:21.273501 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-0f6f8306-715f-42c6-8dfc-93064e21743d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Getting quotas for user 0e30d69a25494d70bc094eb92c4f9bb0 and project 57f927e7829a4172b9919b964a9e7c13. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:27:21.285352 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0f6f8306-715f-42c6-8dfc-93064e21743d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 04:27:21.287701 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0f6f8306-715f-42c6-8dfc-93064e21743d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 132e0a82-5272-4ff5-a141-33f0cb0944a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c63d52d7-4e3d-40cf-a8b5-59a2d027d793',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 04:27:21.336656 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0f6f8306-715f-42c6-8dfc-93064e21743d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.566098 Oct 01 04:27:21.337921 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 487/944] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 1 04:27:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 04:27:21.348958 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-80ec5e24-b396-4534-a2ec-03beb7e5aeff tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:21.349656 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-80ec5e24-b396-4534-a2ec-03beb7e5aeff tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 132e0a82-5272-4ff5-a141-33f0cb0944a1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:21.404592 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-80ec5e24-b396-4534-a2ec-03beb7e5aeff tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:21.411371 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-80ec5e24-b396-4534-a2ec-03beb7e5aeff tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1" status: 200 len: 1241 microversion: 2.1 time: 0.066266 Oct 01 04:27:21.411924 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 458/945] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:21 2022] GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:21.647246 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-86f7d600-f217-4054-be99-ede5040c53c5 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:21.647870 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-86f7d600-f217-4054-be99-ede5040c53c5 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:21.653998 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86f7d600-f217-4054-be99-ede5040c53c5 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:21.654485 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86f7d600-f217-4054-be99-ede5040c53c5 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:21.654923 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86f7d600-f217-4054-be99-ede5040c53c5 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:21.655627 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86f7d600-f217-4054-be99-ede5040c53c5 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:21.656088 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86f7d600-f217-4054-be99-ede5040c53c5 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:21.656515 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-86f7d600-f217-4054-be99-ede5040c53c5 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:21.800623 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-86f7d600-f217-4054-be99-ede5040c53c5 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:21.809209 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-86f7d600-f217-4054-be99-ede5040c53c5 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1576 microversion: 2.1 time: 0.165855 Oct 01 04:27:21.809786 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 488/946] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:21 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:22.434214 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9a2a99cd-790e-4612-b4fd-85b484f632c2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:22.434815 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9a2a99cd-790e-4612-b4fd-85b484f632c2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 132e0a82-5272-4ff5-a141-33f0cb0944a1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:22.441550 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a2a99cd-790e-4612-b4fd-85b484f632c2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:22.442117 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a2a99cd-790e-4612-b4fd-85b484f632c2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:22.442645 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a2a99cd-790e-4612-b4fd-85b484f632c2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:22.443436 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a2a99cd-790e-4612-b4fd-85b484f632c2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:22.443960 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a2a99cd-790e-4612-b4fd-85b484f632c2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:22.444448 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9a2a99cd-790e-4612-b4fd-85b484f632c2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:22.513780 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-9a2a99cd-790e-4612-b4fd-85b484f632c2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:22.522766 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9a2a99cd-790e-4612-b4fd-85b484f632c2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1" status: 200 len: 1301 microversion: 2.1 time: 0.092103 Oct 01 04:27:22.525173 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 459/947] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:22 2022] GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1 => generated 1301 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:27:22.834731 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3c577d35-64b9-4a76-9745-4de81b6ec80c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:22.835436 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3c577d35-64b9-4a76-9745-4de81b6ec80c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:22.842970 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c577d35-64b9-4a76-9745-4de81b6ec80c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:22.843549 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c577d35-64b9-4a76-9745-4de81b6ec80c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:22.844063 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c577d35-64b9-4a76-9745-4de81b6ec80c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:22.844869 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c577d35-64b9-4a76-9745-4de81b6ec80c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:22.845446 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c577d35-64b9-4a76-9745-4de81b6ec80c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:22.845943 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3c577d35-64b9-4a76-9745-4de81b6ec80c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:22.985843 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-3c577d35-64b9-4a76-9745-4de81b6ec80c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:22.993537 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3c577d35-64b9-4a76-9745-4de81b6ec80c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1576 microversion: 2.1 time: 0.162663 Oct 01 04:27:22.994108 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 489/948] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:22 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:23.547444 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3f1c0f8a-a843-4e2a-8f6c-4178fbb1bb38 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:23.548156 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3f1c0f8a-a843-4e2a-8f6c-4178fbb1bb38 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 132e0a82-5272-4ff5-a141-33f0cb0944a1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:23.554559 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f1c0f8a-a843-4e2a-8f6c-4178fbb1bb38 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:23.555048 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f1c0f8a-a843-4e2a-8f6c-4178fbb1bb38 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:23.555486 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f1c0f8a-a843-4e2a-8f6c-4178fbb1bb38 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:23.556755 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f1c0f8a-a843-4e2a-8f6c-4178fbb1bb38 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:23.557246 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f1c0f8a-a843-4e2a-8f6c-4178fbb1bb38 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:23.557681 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3f1c0f8a-a843-4e2a-8f6c-4178fbb1bb38 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:23.687857 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-3f1c0f8a-a843-4e2a-8f6c-4178fbb1bb38 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:23.695803 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3f1c0f8a-a843-4e2a-8f6c-4178fbb1bb38 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1" status: 200 len: 1366 microversion: 2.1 time: 0.152421 Oct 01 04:27:23.696373 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 460/949] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:23 2022] GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:24.018577 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-52646902-e865-4f2a-acd9-6762c6814527 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:24.019217 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-52646902-e865-4f2a-acd9-6762c6814527 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:24.025670 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52646902-e865-4f2a-acd9-6762c6814527 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:24.026371 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52646902-e865-4f2a-acd9-6762c6814527 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:24.026826 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52646902-e865-4f2a-acd9-6762c6814527 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:24.027546 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52646902-e865-4f2a-acd9-6762c6814527 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:24.027993 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52646902-e865-4f2a-acd9-6762c6814527 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:24.028431 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-52646902-e865-4f2a-acd9-6762c6814527 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:24.075926 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-3a7daadf-8e2b-4176-933b-0ec67ad710c8 req-14b729d8-baea-44fa-8729-3a6cc776ff80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "132e0a82-5272-4ff5-a141-33f0cb0944a1", "tag": "5b469383-e557-431c-8ca1-77112c8a8607"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:27:24.094822 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3a7daadf-8e2b-4176-933b-0ec67ad710c8 req-14b729d8-baea-44fa-8729-3a6cc776ff80 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:24.095517 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3a7daadf-8e2b-4176-933b-0ec67ad710c8 req-14b729d8-baea-44fa-8729-3a6cc776ff80 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:24.096131 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-3a7daadf-8e2b-4176-933b-0ec67ad710c8 req-14b729d8-baea-44fa-8729-3a6cc776ff80 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:24.107396 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-3a7daadf-8e2b-4176-933b-0ec67ad710c8 req-14b729d8-baea-44fa-8729-3a6cc776ff80 service nova] Creating event network-changed:5b469383-e557-431c-8ca1-77112c8a8607 for instance 132e0a82-5272-4ff5-a141-33f0cb0944a1 on hv-cinder-86004 Oct 01 04:27:24.112391 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-3a7daadf-8e2b-4176-933b-0ec67ad710c8 req-14b729d8-baea-44fa-8729-3a6cc776ff80 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040782 Oct 01 04:27:24.113248 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 461/950] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:27:24.171364 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-52646902-e865-4f2a-acd9-6762c6814527 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:24.179136 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-52646902-e865-4f2a-acd9-6762c6814527 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1576 microversion: 2.1 time: 0.164743 Oct 01 04:27:24.179691 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 490/951] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:24 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:24.720378 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b28a5df0-448c-478e-aab0-b552041016a7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:24.721131 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b28a5df0-448c-478e-aab0-b552041016a7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 132e0a82-5272-4ff5-a141-33f0cb0944a1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:24.727376 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b28a5df0-448c-478e-aab0-b552041016a7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:24.728461 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b28a5df0-448c-478e-aab0-b552041016a7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:24.728903 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b28a5df0-448c-478e-aab0-b552041016a7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:24.729844 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b28a5df0-448c-478e-aab0-b552041016a7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:24.730175 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b28a5df0-448c-478e-aab0-b552041016a7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:24.730608 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b28a5df0-448c-478e-aab0-b552041016a7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:24.864965 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-b28a5df0-448c-478e-aab0-b552041016a7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:24.872749 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b28a5df0-448c-478e-aab0-b552041016a7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1" status: 200 len: 1366 microversion: 2.1 time: 0.157137 Oct 01 04:27:24.873336 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 462/952] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:24 2022] GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:25.202167 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f550fe2e-9b95-4735-a0c2-381c8f325372 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:25.202929 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f550fe2e-9b95-4735-a0c2-381c8f325372 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:25.209381 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f550fe2e-9b95-4735-a0c2-381c8f325372 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:25.209863 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f550fe2e-9b95-4735-a0c2-381c8f325372 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:25.210298 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f550fe2e-9b95-4735-a0c2-381c8f325372 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:25.210991 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f550fe2e-9b95-4735-a0c2-381c8f325372 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:25.211450 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f550fe2e-9b95-4735-a0c2-381c8f325372 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:25.211871 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f550fe2e-9b95-4735-a0c2-381c8f325372 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:25.348337 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f550fe2e-9b95-4735-a0c2-381c8f325372 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:25.357568 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f550fe2e-9b95-4735-a0c2-381c8f325372 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1576 microversion: 2.1 time: 0.159101 Oct 01 04:27:25.358152 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 491/953] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:25 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:25.896098 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-3e0601c4-222a-4ae0-bd81-74b89b9cabba tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:25.896658 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-3e0601c4-222a-4ae0-bd81-74b89b9cabba tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 132e0a82-5272-4ff5-a141-33f0cb0944a1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:25.903163 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e0601c4-222a-4ae0-bd81-74b89b9cabba tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:25.903665 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e0601c4-222a-4ae0-bd81-74b89b9cabba tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:25.904111 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e0601c4-222a-4ae0-bd81-74b89b9cabba tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:25.904824 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e0601c4-222a-4ae0-bd81-74b89b9cabba tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:25.905323 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e0601c4-222a-4ae0-bd81-74b89b9cabba tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:25.905761 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-3e0601c4-222a-4ae0-bd81-74b89b9cabba tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:26.034575 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-3e0601c4-222a-4ae0-bd81-74b89b9cabba tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:26.043339 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-3e0601c4-222a-4ae0-bd81-74b89b9cabba tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1" status: 200 len: 1366 microversion: 2.1 time: 0.151466 Oct 01 04:27:26.043912 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 463/954] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:25 2022] GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:26.381251 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e275397c-3b09-4c98-aa2d-d5c560ec6241 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:26.381867 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e275397c-3b09-4c98-aa2d-d5c560ec6241 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:26.388367 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e275397c-3b09-4c98-aa2d-d5c560ec6241 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:26.388858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e275397c-3b09-4c98-aa2d-d5c560ec6241 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:26.389332 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e275397c-3b09-4c98-aa2d-d5c560ec6241 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:26.390052 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e275397c-3b09-4c98-aa2d-d5c560ec6241 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:26.390585 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e275397c-3b09-4c98-aa2d-d5c560ec6241 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:26.391092 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e275397c-3b09-4c98-aa2d-d5c560ec6241 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:26.523735 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-e275397c-3b09-4c98-aa2d-d5c560ec6241 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:26.532408 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e275397c-3b09-4c98-aa2d-d5c560ec6241 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1576 microversion: 2.1 time: 0.154978 Oct 01 04:27:26.532988 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 492/955] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:26 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:27.067118 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e46aeb3f-41dc-4fcc-bebb-c328510b8940 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:27.067822 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e46aeb3f-41dc-4fcc-bebb-c328510b8940 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 132e0a82-5272-4ff5-a141-33f0cb0944a1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:27.074409 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e46aeb3f-41dc-4fcc-bebb-c328510b8940 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:27.074906 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e46aeb3f-41dc-4fcc-bebb-c328510b8940 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:27.075350 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e46aeb3f-41dc-4fcc-bebb-c328510b8940 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:27.076061 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e46aeb3f-41dc-4fcc-bebb-c328510b8940 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:27.076532 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e46aeb3f-41dc-4fcc-bebb-c328510b8940 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:27.076984 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e46aeb3f-41dc-4fcc-bebb-c328510b8940 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:27.188833 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-4f4e2f3e-eaae-4d6d-9fff-2e41f8c81103 req-7d8cc546-b1b4-4507-bfe6-4153c1c7c13c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af93c94-483f-4f6d-a017-d45ef01bac8d", "name": "network-vif-plugged", "status": "completed", "tag": "ff800efd-217a-4aea-84a5-e5f05dd17b62"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:27:27.208467 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4f4e2f3e-eaae-4d6d-9fff-2e41f8c81103 req-7d8cc546-b1b4-4507-bfe6-4153c1c7c13c service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:27.209146 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4f4e2f3e-eaae-4d6d-9fff-2e41f8c81103 req-7d8cc546-b1b4-4507-bfe6-4153c1c7c13c service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:27.209862 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4f4e2f3e-eaae-4d6d-9fff-2e41f8c81103 req-7d8cc546-b1b4-4507-bfe6-4153c1c7c13c service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:27.222835 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-4f4e2f3e-eaae-4d6d-9fff-2e41f8c81103 req-7d8cc546-b1b4-4507-bfe6-4153c1c7c13c service nova] Creating event network-vif-plugged:ff800efd-217a-4aea-84a5-e5f05dd17b62 for instance 2af93c94-483f-4f6d-a017-d45ef01bac8d on hv-cinder-86004 Oct 01 04:27:27.228153 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-4f4e2f3e-eaae-4d6d-9fff-2e41f8c81103 req-7d8cc546-b1b4-4507-bfe6-4153c1c7c13c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043562 Oct 01 04:27:27.229516 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 493/956] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:27:27.241436 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-e46aeb3f-41dc-4fcc-bebb-c328510b8940 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:27.249226 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e46aeb3f-41dc-4fcc-bebb-c328510b8940 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1" status: 200 len: 1366 microversion: 2.1 time: 0.185977 Oct 01 04:27:27.249794 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 464/957] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:27 2022] GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:27.556770 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-64659d15-ab5d-4940-8f43-fbac31868e7c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:27.557547 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-64659d15-ab5d-4940-8f43-fbac31868e7c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:27.563589 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64659d15-ab5d-4940-8f43-fbac31868e7c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:27.564079 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64659d15-ab5d-4940-8f43-fbac31868e7c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:27.564517 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64659d15-ab5d-4940-8f43-fbac31868e7c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:27.565245 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64659d15-ab5d-4940-8f43-fbac31868e7c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:27.565711 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64659d15-ab5d-4940-8f43-fbac31868e7c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:27.566143 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-64659d15-ab5d-4940-8f43-fbac31868e7c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:27.700480 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-64659d15-ab5d-4940-8f43-fbac31868e7c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:27.708251 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-64659d15-ab5d-4940-8f43-fbac31868e7c tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1576 microversion: 2.1 time: 0.156294 Oct 01 04:27:27.708823 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 494/958] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:27 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:28.273163 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-039a97bd-8a51-4b8f-a356-bd53789bbadf tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:28.273780 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-039a97bd-8a51-4b8f-a356-bd53789bbadf tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 132e0a82-5272-4ff5-a141-33f0cb0944a1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:28.280738 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-039a97bd-8a51-4b8f-a356-bd53789bbadf tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:28.281259 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-039a97bd-8a51-4b8f-a356-bd53789bbadf tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:28.281701 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-039a97bd-8a51-4b8f-a356-bd53789bbadf tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:28.282398 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-039a97bd-8a51-4b8f-a356-bd53789bbadf tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:28.282865 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-039a97bd-8a51-4b8f-a356-bd53789bbadf tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:28.283296 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-039a97bd-8a51-4b8f-a356-bd53789bbadf tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:28.414325 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-039a97bd-8a51-4b8f-a356-bd53789bbadf tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:28.422588 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-039a97bd-8a51-4b8f-a356-bd53789bbadf tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1" status: 200 len: 1366 microversion: 2.1 time: 0.153347 Oct 01 04:27:28.423154 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 465/959] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:28 2022] GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:28.731632 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-bf647723-b17a-42df-b864-3ba08e520df8 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:28.732257 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-bf647723-b17a-42df-b864-3ba08e520df8 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:28.734785 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:27:28.740058 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf647723-b17a-42df-b864-3ba08e520df8 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:28.740549 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf647723-b17a-42df-b864-3ba08e520df8 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:28.741016 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf647723-b17a-42df-b864-3ba08e520df8 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:28.741718 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf647723-b17a-42df-b864-3ba08e520df8 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:28.742181 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf647723-b17a-42df-b864-3ba08e520df8 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:28.742613 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-bf647723-b17a-42df-b864-3ba08e520df8 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:28.882262 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-bf647723-b17a-42df-b864-3ba08e520df8 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:28.890621 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-bf647723-b17a-42df-b864-3ba08e520df8 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1576 microversion: 2.1 time: 0.163098 Oct 01 04:27:28.891191 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 495/960] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:28 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:29.259718 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-c219ccd7-46ee-41c5-9efe-c41906ccb44a req-3f51fa30-edb7-401f-a427-ddf4a3d68e60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "132e0a82-5272-4ff5-a141-33f0cb0944a1", "name": "network-vif-plugged", "status": "completed", "tag": "5b469383-e557-431c-8ca1-77112c8a8607"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:27:29.269149 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c219ccd7-46ee-41c5-9efe-c41906ccb44a req-3f51fa30-edb7-401f-a427-ddf4a3d68e60 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:29.269627 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c219ccd7-46ee-41c5-9efe-c41906ccb44a req-3f51fa30-edb7-401f-a427-ddf4a3d68e60 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:29.270063 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-c219ccd7-46ee-41c5-9efe-c41906ccb44a req-3f51fa30-edb7-401f-a427-ddf4a3d68e60 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:29.281783 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-c219ccd7-46ee-41c5-9efe-c41906ccb44a req-3f51fa30-edb7-401f-a427-ddf4a3d68e60 service nova] Creating event network-vif-plugged:5b469383-e557-431c-8ca1-77112c8a8607 for instance 132e0a82-5272-4ff5-a141-33f0cb0944a1 on hv-cinder-86004 Oct 01 04:27:29.287026 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-c219ccd7-46ee-41c5-9efe-c41906ccb44a req-3f51fa30-edb7-401f-a427-ddf4a3d68e60 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030807 Oct 01 04:27:29.287527 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 466/961] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:27:29.445312 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0c3a4355-2817-4c0a-a14d-ad2aed0ddd15 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:29.445929 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0c3a4355-2817-4c0a-a14d-ad2aed0ddd15 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 132e0a82-5272-4ff5-a141-33f0cb0944a1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:29.452748 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0c3a4355-2817-4c0a-a14d-ad2aed0ddd15 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:29.453295 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0c3a4355-2817-4c0a-a14d-ad2aed0ddd15 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:29.453737 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0c3a4355-2817-4c0a-a14d-ad2aed0ddd15 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:29.454448 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0c3a4355-2817-4c0a-a14d-ad2aed0ddd15 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:29.454912 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0c3a4355-2817-4c0a-a14d-ad2aed0ddd15 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:29.455342 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0c3a4355-2817-4c0a-a14d-ad2aed0ddd15 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:29.588071 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0c3a4355-2817-4c0a-a14d-ad2aed0ddd15 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:29.595762 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0c3a4355-2817-4c0a-a14d-ad2aed0ddd15 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1" status: 200 len: 1366 microversion: 2.1 time: 0.154427 Oct 01 04:27:29.596321 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 496/962] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:29 2022] GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:29.915926 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c961a468-bc9b-415f-bac6-da8b0edc2335 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:29.916580 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c961a468-bc9b-415f-bac6-da8b0edc2335 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:29.922840 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c961a468-bc9b-415f-bac6-da8b0edc2335 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:29.923341 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c961a468-bc9b-415f-bac6-da8b0edc2335 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:29.923784 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c961a468-bc9b-415f-bac6-da8b0edc2335 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:29.924483 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c961a468-bc9b-415f-bac6-da8b0edc2335 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:29.924974 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c961a468-bc9b-415f-bac6-da8b0edc2335 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:29.925410 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c961a468-bc9b-415f-bac6-da8b0edc2335 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:30.057416 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c961a468-bc9b-415f-bac6-da8b0edc2335 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:30.065150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c961a468-bc9b-415f-bac6-da8b0edc2335 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1563 microversion: 2.1 time: 0.153562 Oct 01 04:27:30.065748 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 467/963] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:29 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:30.619161 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1b194fc7-7f51-44f5-9e1e-3785e533c467 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:30.619933 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1b194fc7-7f51-44f5-9e1e-3785e533c467 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 132e0a82-5272-4ff5-a141-33f0cb0944a1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:30.626319 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b194fc7-7f51-44f5-9e1e-3785e533c467 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:30.626807 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b194fc7-7f51-44f5-9e1e-3785e533c467 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:30.627278 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b194fc7-7f51-44f5-9e1e-3785e533c467 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:30.627972 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b194fc7-7f51-44f5-9e1e-3785e533c467 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:30.628432 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b194fc7-7f51-44f5-9e1e-3785e533c467 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:30.628858 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1b194fc7-7f51-44f5-9e1e-3785e533c467 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:30.755838 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-1b194fc7-7f51-44f5-9e1e-3785e533c467 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:27:30.764200 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1b194fc7-7f51-44f5-9e1e-3785e533c467 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1" status: 200 len: 1555 microversion: 2.1 time: 0.149597 Oct 01 04:27:30.764755 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 497/964] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:27:30 2022] GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:27:30.786511 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b6d0d3fa-8391-4897-ae31-bc17a85404b1 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:27:30.787009 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b6d0d3fa-8391-4897-ae31-bc17a85404b1 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 132e0a82-5272-4ff5-a141-33f0cb0944a1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:27:30.793422 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6d0d3fa-8391-4897-ae31-bc17a85404b1 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:30.793900 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6d0d3fa-8391-4897-ae31-bc17a85404b1 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:30.794338 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6d0d3fa-8391-4897-ae31-bc17a85404b1 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:30.795030 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6d0d3fa-8391-4897-ae31-bc17a85404b1 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:30.795491 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6d0d3fa-8391-4897-ae31-bc17a85404b1 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:30.795916 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b6d0d3fa-8391-4897-ae31-bc17a85404b1 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:30.871541 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b6d0d3fa-8391-4897-ae31-bc17a85404b1 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088728 Oct 01 04:27:30.872135 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 468/965] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 1 04:27:30 2022] GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:27:31.801177 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-ce320686-9dc5-4eda-9072-e1fa11504439 req-0abcd1e9-f39e-4e29-b9a2-d833156e2d39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "132e0a82-5272-4ff5-a141-33f0cb0944a1", "tag": "5b469383-e557-431c-8ca1-77112c8a8607"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:27:31.806072 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:27:31.806932 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=10 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:27:31.814234 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ce320686-9dc5-4eda-9072-e1fa11504439 req-0abcd1e9-f39e-4e29-b9a2-d833156e2d39 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:27:31.814749 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ce320686-9dc5-4eda-9072-e1fa11504439 req-0abcd1e9-f39e-4e29-b9a2-d833156e2d39 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:27:31.815178 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-ce320686-9dc5-4eda-9072-e1fa11504439 req-0abcd1e9-f39e-4e29-b9a2-d833156e2d39 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:27:31.826908 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-ce320686-9dc5-4eda-9072-e1fa11504439 req-0abcd1e9-f39e-4e29-b9a2-d833156e2d39 service nova] Creating event network-changed:5b469383-e557-431c-8ca1-77112c8a8607 for instance 132e0a82-5272-4ff5-a141-33f0cb0944a1 on hv-cinder-86004 Oct 01 04:27:31.831896 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-ce320686-9dc5-4eda-9072-e1fa11504439 req-0abcd1e9-f39e-4e29-b9a2-d833156e2d39 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034437 Oct 01 04:27:31.832517 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 498/966] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:28:03.714965 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:28:03.718384 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=7 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:28:03.720328 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:28:03.720987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=66 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:28:03.724834 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6d253f6e-c567-4a2d-ba85-6f3c1f04f87d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:03.725724 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:28:03.729943 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-1a7625c3-d5d1-4fbb-a9bc-988f95063002 req-a81a4aef-6740-478d-84e8-d816130b6d8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d05ad71a-601e-42a7-a215-04477dc66444", "tag": "1c202297-17f7-4fc4-9e9a-a51de8a73129"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:28:03.737550 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6d253f6e-c567-4a2d-ba85-6f3c1f04f87d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: d05ad71a-601e-42a7-a215-04477dc66444] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:03.745306 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d253f6e-c567-4a2d-ba85-6f3c1f04f87d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:03.745812 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d253f6e-c567-4a2d-ba85-6f3c1f04f87d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:03.746259 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d253f6e-c567-4a2d-ba85-6f3c1f04f87d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:03.747574 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d253f6e-c567-4a2d-ba85-6f3c1f04f87d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:03.748119 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d253f6e-c567-4a2d-ba85-6f3c1f04f87d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:03.748547 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6d253f6e-c567-4a2d-ba85-6f3c1f04f87d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:03.753751 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1a7625c3-d5d1-4fbb-a9bc-988f95063002 req-a81a4aef-6740-478d-84e8-d816130b6d8f service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:03.754232 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1a7625c3-d5d1-4fbb-a9bc-988f95063002 req-a81a4aef-6740-478d-84e8-d816130b6d8f service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:03.754667 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-1a7625c3-d5d1-4fbb-a9bc-988f95063002 req-a81a4aef-6740-478d-84e8-d816130b6d8f service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:03.773215 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-1a7625c3-d5d1-4fbb-a9bc-988f95063002 req-a81a4aef-6740-478d-84e8-d816130b6d8f service nova] Creating event network-changed:1c202297-17f7-4fc4-9e9a-a51de8a73129 for instance d05ad71a-601e-42a7-a215-04477dc66444 on hv-cinder-86004 Oct 01 04:28:03.778637 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-1a7625c3-d5d1-4fbb-a9bc-988f95063002 req-a81a4aef-6740-478d-84e8-d816130b6d8f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061853 Oct 01 04:28:03.779229 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 499/967] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:28:03.787569 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6d253f6e-c567-4a2d-ba85-6f3c1f04f87d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: d05ad71a-601e-42a7-a215-04477dc66444] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 04:28:03.878657 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6d253f6e-c567-4a2d-ba85-6f3c1f04f87d tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444" status: 204 len: 0 microversion: 2.1 time: 0.164250 Oct 01 04:28:03.879474 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 469/968] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 1 04:28:03 2022] DELETE /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 04:28:03.888177 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-19575a44-2054-4fb6-a5ae-9eb54fd0b6fa tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:03.888900 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-19575a44-2054-4fb6-a5ae-9eb54fd0b6fa tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: d05ad71a-601e-42a7-a215-04477dc66444] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:03.895521 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19575a44-2054-4fb6-a5ae-9eb54fd0b6fa tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:03.896019 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19575a44-2054-4fb6-a5ae-9eb54fd0b6fa tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:03.896460 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19575a44-2054-4fb6-a5ae-9eb54fd0b6fa tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:03.897217 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19575a44-2054-4fb6-a5ae-9eb54fd0b6fa tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:03.897682 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19575a44-2054-4fb6-a5ae-9eb54fd0b6fa tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:03.898117 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-19575a44-2054-4fb6-a5ae-9eb54fd0b6fa tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:04.267322 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-19575a44-2054-4fb6-a5ae-9eb54fd0b6fa tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:28:04.275116 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-19575a44-2054-4fb6-a5ae-9eb54fd0b6fa tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444" status: 200 len: 1578 microversion: 2.1 time: 0.391383 Oct 01 04:28:04.275694 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 500/969] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:28:03 2022] GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444 => generated 1578 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:28:05.300199 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8271400a-a1ea-4cc9-91c5-5c8b761b098b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:05.300897 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8271400a-a1ea-4cc9-91c5-5c8b761b098b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: d05ad71a-601e-42a7-a215-04477dc66444] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:05.307108 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8271400a-a1ea-4cc9-91c5-5c8b761b098b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:05.307593 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8271400a-a1ea-4cc9-91c5-5c8b761b098b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:05.308031 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8271400a-a1ea-4cc9-91c5-5c8b761b098b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:05.308728 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8271400a-a1ea-4cc9-91c5-5c8b761b098b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:05.309213 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8271400a-a1ea-4cc9-91c5-5c8b761b098b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:05.310375 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8271400a-a1ea-4cc9-91c5-5c8b761b098b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:05.496510 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-8271400a-a1ea-4cc9-91c5-5c8b761b098b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:28:05.504408 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8271400a-a1ea-4cc9-91c5-5c8b761b098b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444" status: 200 len: 1578 microversion: 2.1 time: 0.208402 Oct 01 04:28:05.504992 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 470/970] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:28:05 2022] GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444 => generated 1578 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:28:06.075818 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-56b62816-aeb4-40cb-801b-88ec9a799cf5 req-e11a9dce-ffb5-4d81-a95a-a68eac8bcabb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d05ad71a-601e-42a7-a215-04477dc66444", "name": "network-vif-deleted", "tag": "1c202297-17f7-4fc4-9e9a-a51de8a73129"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:28:06.087008 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-56b62816-aeb4-40cb-801b-88ec9a799cf5 req-e11a9dce-ffb5-4d81-a95a-a68eac8bcabb service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:06.087586 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-56b62816-aeb4-40cb-801b-88ec9a799cf5 req-e11a9dce-ffb5-4d81-a95a-a68eac8bcabb service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:06.088268 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-56b62816-aeb4-40cb-801b-88ec9a799cf5 req-e11a9dce-ffb5-4d81-a95a-a68eac8bcabb service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:06.105283 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-56b62816-aeb4-40cb-801b-88ec9a799cf5 req-e11a9dce-ffb5-4d81-a95a-a68eac8bcabb service nova] Creating event network-vif-deleted:1c202297-17f7-4fc4-9e9a-a51de8a73129 for instance d05ad71a-601e-42a7-a215-04477dc66444 on hv-cinder-86004 Oct 01 04:28:06.111427 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-56b62816-aeb4-40cb-801b-88ec9a799cf5 req-e11a9dce-ffb5-4d81-a95a-a68eac8bcabb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040488 Oct 01 04:28:06.112145 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 501/971] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:28:06.527495 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-91b1119f-6d7d-4a9b-885c-2f6bd3150785 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:06.528872 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-91b1119f-6d7d-4a9b-885c-2f6bd3150785 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: d05ad71a-601e-42a7-a215-04477dc66444] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:06.535462 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91b1119f-6d7d-4a9b-885c-2f6bd3150785 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:06.535955 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91b1119f-6d7d-4a9b-885c-2f6bd3150785 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:06.536401 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91b1119f-6d7d-4a9b-885c-2f6bd3150785 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:06.537205 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91b1119f-6d7d-4a9b-885c-2f6bd3150785 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:06.537681 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91b1119f-6d7d-4a9b-885c-2f6bd3150785 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:06.538116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91b1119f-6d7d-4a9b-885c-2f6bd3150785 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:06.570786 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91b1119f-6d7d-4a9b-885c-2f6bd3150785 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:06.571219 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91b1119f-6d7d-4a9b-885c-2f6bd3150785 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:06.571662 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91b1119f-6d7d-4a9b-885c-2f6bd3150785 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:06.572112 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-91b1119f-6d7d-4a9b-885c-2f6bd3150785 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lazy-loading 'fault' on Instance uuid d05ad71a-601e-42a7-a215-04477dc66444 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:28:06.612010 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-91b1119f-6d7d-4a9b-885c-2f6bd3150785 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:28:06.619646 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-91b1119f-6d7d-4a9b-885c-2f6bd3150785 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444" status: 200 len: 1230 microversion: 2.1 time: 0.095871 Oct 01 04:28:06.620223 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 471/972] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:28:06 2022] GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444 => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:28:07.646959 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e7b06cc1-bf16-4e7b-b8cf-59d56b6a52b2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:07.647698 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e7b06cc1-bf16-4e7b-b8cf-59d56b6a52b2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: d05ad71a-601e-42a7-a215-04477dc66444] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:07.654446 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7b06cc1-bf16-4e7b-b8cf-59d56b6a52b2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:07.654930 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7b06cc1-bf16-4e7b-b8cf-59d56b6a52b2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:07.655371 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7b06cc1-bf16-4e7b-b8cf-59d56b6a52b2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:07.656065 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7b06cc1-bf16-4e7b-b8cf-59d56b6a52b2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:07.656529 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7b06cc1-bf16-4e7b-b8cf-59d56b6a52b2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:07.656975 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7b06cc1-bf16-4e7b-b8cf-59d56b6a52b2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:07.670771 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-e7b06cc1-bf16-4e7b-b8cf-59d56b6a52b2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] HTTP exception thrown: Instance d05ad71a-601e-42a7-a215-04477dc66444 could not be found. Oct 01 04:28:07.672390 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e7b06cc1-bf16-4e7b-b8cf-59d56b6a52b2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Request method failure captured: Oct 01 04:28:07.672390 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444 HTTP/1.1 Oct 01 04:28:07.672390 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:28:07.672390 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:28:07.672390 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:28:07.672390 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 0 Oct 01 04:28:07.672390 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:28:07.672390 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:28:07.672390 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:28:07.672390 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:28:07.672390 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN7_-6vOf5LAXMJpNxgHCXAL5Yp_KV-I0ygMkF8xEYZOdOvZKckxX5HUNO3pw108A69ZwDA0bYsnx9P5YHYocO16Z7ax6mNXSFOBYjPJMQdJY1ME4QGMgu0rxDHvGGJq-CjqrTfLFyN7kotOulhYPoCsLTqZiUqAg5_l6o0qdPQrD0SE Oct 01 04:28:07.672390 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:28:07.672390 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:28:07.672390 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:28:07.672390 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:28:07.672390 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:28:07.672390 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:28:07.672390 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: 721dd52b82194e4d91113d4d688900ae Oct 01 04:28:07.672390 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-TestVolumeBootPattern-774411632 Oct 01 04:28:07.672390 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:28:07.672390 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:28:07.674162 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_721dd52b82194e4d91113d4d688900ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/721dd52b82194e4d91113d4d688900ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/721dd52b82194e4d91113d4d688900ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/721dd52b82194e4d91113d4d688900ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:28:07.674162 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-TestVolumeBootPattern-774411632 Oct 01 04:28:07.674162 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 721dd52b82194e4d91113d4d688900ae Oct 01 04:28:07.674162 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestVolumeBootPattern-774411632 Oct 01 04:28:07.674162 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-TestVolumeBootPattern-774411632-project Oct 01 04:28:07.674162 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:28:07.674162 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:28:07.674162 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: dea6fd8e6a374cd5b12ec7d99f285203 Oct 01 04:28:07.674162 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-TestVolumeBootPattern-774411632-project Oct 01 04:28:07.674162 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: > Oct 01 04:28:07.674162 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Instance d05ad71a-601e-42a7-a215-04477dc66444 could not be found. Oct 01 04:28:07.674162 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'id': 'd05ad71a-601e-42a7-a215-04477dc66444'} Oct 01 04:28:07.675074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:28:07.675074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:28:07.675074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:28:07.675074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:28:07.675074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:28:07.675074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:28:07.675074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:28:07.675074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:28:07.675074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:28:07.675074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:28:07.675074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d05ad71a-601e-42a7-a215-04477dc66444 could not be found. Oct 01 04:28:07.675074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:28:07.675074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:28:07.675074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:28:07.675074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:28:07.675074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:28:07.675074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:28:07.675074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:28:07.675074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:28:07.675074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:28:07.676467 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:28:07.676467 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:28:07.676467 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:28:07.676467 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:28:07.676467 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:28:07.676467 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:28:07.676467 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:28:07.676467 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d05ad71a-601e-42a7-a215-04477dc66444 could not be found. Oct 01 04:28:07.676467 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:28:07.676467 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:28:07.676467 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:28:07.676467 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:28:07.676467 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:28:07.676467 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:28:07.676467 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:28:07.676467 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:28:07.676467 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d05ad71a-601e-42a7-a215-04477dc66444 could not be found. Oct 01 04:28:07.676467 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:28:07.677710 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e7b06cc1-bf16-4e7b-b8cf-59d56b6a52b2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Returning 404 to user: Instance d05ad71a-601e-42a7-a215-04477dc66444 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:28:07.677710 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e7b06cc1-bf16-4e7b-b8cf-59d56b6a52b2 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444" status: 404 len: 111 microversion: 2.1 time: 0.033822 Oct 01 04:28:07.677710 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 502/973] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:28:07 2022] GET /compute/v2.1/servers/d05ad71a-601e-42a7-a215-04477dc66444 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:28:07.775129 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e056d16f-dca0-4f32-94d3-2f027559a7b5 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:07.775719 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-e056d16f-dca0-4f32-94d3-2f027559a7b5 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 132e0a82-5272-4ff5-a141-33f0cb0944a1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:07.783078 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e056d16f-dca0-4f32-94d3-2f027559a7b5 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:07.783564 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e056d16f-dca0-4f32-94d3-2f027559a7b5 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:07.784002 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e056d16f-dca0-4f32-94d3-2f027559a7b5 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:07.784844 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e056d16f-dca0-4f32-94d3-2f027559a7b5 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:07.785330 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e056d16f-dca0-4f32-94d3-2f027559a7b5 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:07.785777 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-e056d16f-dca0-4f32-94d3-2f027559a7b5 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:07.808837 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e056d16f-dca0-4f32-94d3-2f027559a7b5 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1/ips" status: 200 len: 148 microversion: 2.1 time: 0.038338 Oct 01 04:28:07.809464 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 472/974] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 1 04:28:07 2022] GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:28:09.165036 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6ce24e8a-d6e8-4647-a35b-dc7ca26a715c tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5de45126-a30a-4e71-819c-1580819e1b96"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:28:09.167374 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6ce24e8a-d6e8-4647-a35b-dc7ca26a715c tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 132e0a82-5272-4ff5-a141-33f0cb0944a1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:09.174449 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ce24e8a-d6e8-4647-a35b-dc7ca26a715c tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:09.175272 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ce24e8a-d6e8-4647-a35b-dc7ca26a715c tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:09.175722 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ce24e8a-d6e8-4647-a35b-dc7ca26a715c tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:09.176443 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ce24e8a-d6e8-4647-a35b-dc7ca26a715c tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:09.176910 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ce24e8a-d6e8-4647-a35b-dc7ca26a715c tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:09.177399 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6ce24e8a-d6e8-4647-a35b-dc7ca26a715c tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:09.418271 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6ce24e8a-d6e8-4647-a35b-dc7ca26a715c tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "POST /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256665 Oct 01 04:28:09.418936 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 503/975] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 1 04:28:09 2022] POST /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:28:11.003525 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-e8a4302d-a16c-4eb4-9bf5-cce5de2310ae req-a399a815-2f69-4994-bf5e-6a6622f674d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87cd0cbd-547d-4e0e-a797-7971ce307b17", "tag": "998978bd-7095-4f80-b84b-5589f1d6add2"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:28:11.006592 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-5e4170fe-ab4f-4c26-9815-4e6c9a49f78b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:11.007099 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5e4170fe-ab4f-4c26-9815-4e6c9a49f78b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 87cd0cbd-547d-4e0e-a797-7971ce307b17] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:11.013621 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e4170fe-ab4f-4c26-9815-4e6c9a49f78b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:11.013815 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e8a4302d-a16c-4eb4-9bf5-cce5de2310ae req-a399a815-2f69-4994-bf5e-6a6622f674d7 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:11.014116 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e4170fe-ab4f-4c26-9815-4e6c9a49f78b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:11.014274 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e8a4302d-a16c-4eb4-9bf5-cce5de2310ae req-a399a815-2f69-4994-bf5e-6a6622f674d7 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:11.014560 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e4170fe-ab4f-4c26-9815-4e6c9a49f78b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:11.015445 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e8a4302d-a16c-4eb4-9bf5-cce5de2310ae req-a399a815-2f69-4994-bf5e-6a6622f674d7 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:11.015573 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e4170fe-ab4f-4c26-9815-4e6c9a49f78b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:11.015717 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e4170fe-ab4f-4c26-9815-4e6c9a49f78b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:11.016127 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-5e4170fe-ab4f-4c26-9815-4e6c9a49f78b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:11.026621 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-e8a4302d-a16c-4eb4-9bf5-cce5de2310ae req-a399a815-2f69-4994-bf5e-6a6622f674d7 service nova] Creating event network-changed:998978bd-7095-4f80-b84b-5589f1d6add2 for instance 87cd0cbd-547d-4e0e-a797-7971ce307b17 on hv-cinder-86004 Oct 01 04:28:11.031799 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-e8a4302d-a16c-4eb4-9bf5-cce5de2310ae req-a399a815-2f69-4994-bf5e-6a6622f674d7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032186 Oct 01 04:28:11.032604 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 504/976] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:28:11.045470 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-5e4170fe-ab4f-4c26-9815-4e6c9a49f78b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 87cd0cbd-547d-4e0e-a797-7971ce307b17] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 04:28:11.131521 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-5e4170fe-ab4f-4c26-9815-4e6c9a49f78b tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "DELETE /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17" status: 204 len: 0 microversion: 2.1 time: 0.135215 Oct 01 04:28:11.137018 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 473/977] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 1 04:28:10 2022] DELETE /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 04:28:11.143376 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2a8a414c-1e88-4d27-a96d-ca799be99476 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:11.144352 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2a8a414c-1e88-4d27-a96d-ca799be99476 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 87cd0cbd-547d-4e0e-a797-7971ce307b17] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:11.151229 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a8a414c-1e88-4d27-a96d-ca799be99476 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:11.152027 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a8a414c-1e88-4d27-a96d-ca799be99476 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:11.152677 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a8a414c-1e88-4d27-a96d-ca799be99476 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:11.154183 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a8a414c-1e88-4d27-a96d-ca799be99476 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:11.154849 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a8a414c-1e88-4d27-a96d-ca799be99476 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:11.155478 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2a8a414c-1e88-4d27-a96d-ca799be99476 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:11.297531 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2a8a414c-1e88-4d27-a96d-ca799be99476 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:28:11.305279 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2a8a414c-1e88-4d27-a96d-ca799be99476 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17" status: 200 len: 1579 microversion: 2.1 time: 0.167989 Oct 01 04:28:11.305843 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 505/978] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:28:11 2022] GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17 => generated 1579 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:28:12.330755 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8c5a44e1-aeba-4c62-9672-6386c7520f85 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:12.331463 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8c5a44e1-aeba-4c62-9672-6386c7520f85 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 87cd0cbd-547d-4e0e-a797-7971ce307b17] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:12.337701 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c5a44e1-aeba-4c62-9672-6386c7520f85 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:12.338186 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c5a44e1-aeba-4c62-9672-6386c7520f85 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:12.338641 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c5a44e1-aeba-4c62-9672-6386c7520f85 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:12.339392 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c5a44e1-aeba-4c62-9672-6386c7520f85 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:12.339849 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c5a44e1-aeba-4c62-9672-6386c7520f85 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:12.340271 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8c5a44e1-aeba-4c62-9672-6386c7520f85 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:12.471566 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-8c5a44e1-aeba-4c62-9672-6386c7520f85 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:28:12.479314 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8c5a44e1-aeba-4c62-9672-6386c7520f85 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17" status: 200 len: 1579 microversion: 2.1 time: 0.153186 Oct 01 04:28:12.479879 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 474/979] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:28:12 2022] GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17 => generated 1579 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:28:13.073611 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-4c023e2e-4e8d-471f-9996-143c6b4388e8 req-d26af641-9d00-4f0a-9889-9eb01665c71d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87cd0cbd-547d-4e0e-a797-7971ce307b17", "name": "network-vif-deleted", "tag": "998978bd-7095-4f80-b84b-5589f1d6add2"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:28:13.085558 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4c023e2e-4e8d-471f-9996-143c6b4388e8 req-d26af641-9d00-4f0a-9889-9eb01665c71d service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:13.086042 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4c023e2e-4e8d-471f-9996-143c6b4388e8 req-d26af641-9d00-4f0a-9889-9eb01665c71d service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:13.086474 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-4c023e2e-4e8d-471f-9996-143c6b4388e8 req-d26af641-9d00-4f0a-9889-9eb01665c71d service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:13.098327 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-4c023e2e-4e8d-471f-9996-143c6b4388e8 req-d26af641-9d00-4f0a-9889-9eb01665c71d service nova] Creating event network-vif-deleted:998978bd-7095-4f80-b84b-5589f1d6add2 for instance 87cd0cbd-547d-4e0e-a797-7971ce307b17 on hv-cinder-86004 Oct 01 04:28:13.102840 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-4c023e2e-4e8d-471f-9996-143c6b4388e8 req-d26af641-9d00-4f0a-9889-9eb01665c71d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032914 Oct 01 04:28:13.103419 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 506/980] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:28:13.501922 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-0eb8da1b-0756-4798-93e5-291374bad536 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:13.502540 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-0eb8da1b-0756-4798-93e5-291374bad536 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 87cd0cbd-547d-4e0e-a797-7971ce307b17] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:13.508593 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0eb8da1b-0756-4798-93e5-291374bad536 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:13.509114 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0eb8da1b-0756-4798-93e5-291374bad536 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:13.509552 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0eb8da1b-0756-4798-93e5-291374bad536 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:13.510240 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0eb8da1b-0756-4798-93e5-291374bad536 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:13.510700 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0eb8da1b-0756-4798-93e5-291374bad536 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:13.511120 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0eb8da1b-0756-4798-93e5-291374bad536 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:13.542353 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0eb8da1b-0756-4798-93e5-291374bad536 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:13.542838 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0eb8da1b-0756-4798-93e5-291374bad536 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:13.543270 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-0eb8da1b-0756-4798-93e5-291374bad536 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:13.543763 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-0eb8da1b-0756-4798-93e5-291374bad536 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lazy-loading 'fault' on Instance uuid 87cd0cbd-547d-4e0e-a797-7971ce307b17 {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:28:13.584077 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-0eb8da1b-0756-4798-93e5-291374bad536 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dea6fd8e6a374cd5b12ec7d99f285203', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721dd52b82194e4d91113d4d688900ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:28:13.591749 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-0eb8da1b-0756-4798-93e5-291374bad536 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17" status: 200 len: 1231 microversion: 2.1 time: 0.093710 Oct 01 04:28:13.592305 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 475/981] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:28:13 2022] GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17 => generated 1231 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:28:14.615291 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d6d74fbf-8688-4326-9edc-556da8672c43 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:14.616023 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d6d74fbf-8688-4326-9edc-556da8672c43 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 87cd0cbd-547d-4e0e-a797-7971ce307b17] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:14.622288 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6d74fbf-8688-4326-9edc-556da8672c43 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:14.622883 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6d74fbf-8688-4326-9edc-556da8672c43 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:14.623321 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6d74fbf-8688-4326-9edc-556da8672c43 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:14.624014 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6d74fbf-8688-4326-9edc-556da8672c43 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:14.624476 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6d74fbf-8688-4326-9edc-556da8672c43 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:14.624903 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d6d74fbf-8688-4326-9edc-556da8672c43 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:14.638205 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-d6d74fbf-8688-4326-9edc-556da8672c43 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] HTTP exception thrown: Instance 87cd0cbd-547d-4e0e-a797-7971ce307b17 could not be found. Oct 01 04:28:14.639834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d6d74fbf-8688-4326-9edc-556da8672c43 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Request method failure captured: Oct 01 04:28:14.639834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17 HTTP/1.1 Oct 01 04:28:14.639834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:28:14.639834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:28:14.639834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:28:14.639834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 0 Oct 01 04:28:14.639834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:28:14.639834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:28:14.639834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:28:14.639834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:28:14.639834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN7_-6vOf5LAXMJpNxgHCXAL5Yp_KV-I0ygMkF8xEYZOdOvZKckxX5HUNO3pw108A69ZwDA0bYsnx9P5YHYocO16Z7ax6mNXSFOBYjPJMQdJY1ME4QGMgu0rxDHvGGJq-CjqrTfLFyN7kotOulhYPoCsLTqZiUqAg5_l6o0qdPQrD0SE Oct 01 04:28:14.639834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:28:14.639834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:28:14.639834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:28:14.639834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:28:14.639834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:28:14.639834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:28:14.639834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: 721dd52b82194e4d91113d4d688900ae Oct 01 04:28:14.639834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-TestVolumeBootPattern-774411632 Oct 01 04:28:14.639834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:28:14.639834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:28:14.641591 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_721dd52b82194e4d91113d4d688900ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/721dd52b82194e4d91113d4d688900ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/721dd52b82194e4d91113d4d688900ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/721dd52b82194e4d91113d4d688900ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:28:14.641591 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-TestVolumeBootPattern-774411632 Oct 01 04:28:14.641591 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 721dd52b82194e4d91113d4d688900ae Oct 01 04:28:14.641591 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestVolumeBootPattern-774411632 Oct 01 04:28:14.641591 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-TestVolumeBootPattern-774411632-project Oct 01 04:28:14.641591 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:28:14.641591 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:28:14.641591 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: dea6fd8e6a374cd5b12ec7d99f285203 Oct 01 04:28:14.641591 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-TestVolumeBootPattern-774411632-project Oct 01 04:28:14.641591 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: > Oct 01 04:28:14.641591 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Instance 87cd0cbd-547d-4e0e-a797-7971ce307b17 could not be found. Oct 01 04:28:14.641591 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'id': '87cd0cbd-547d-4e0e-a797-7971ce307b17'} Oct 01 04:28:14.642881 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:28:14.642881 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:28:14.642881 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:28:14.642881 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:28:14.642881 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:28:14.642881 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:28:14.642881 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:28:14.642881 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:28:14.642881 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:28:14.642881 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:28:14.642881 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87cd0cbd-547d-4e0e-a797-7971ce307b17 could not be found. Oct 01 04:28:14.642881 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:28:14.642881 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:28:14.642881 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:28:14.642881 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:28:14.642881 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:28:14.642881 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:28:14.642881 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:28:14.642881 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:28:14.642881 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:28:14.644404 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:28:14.644404 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:28:14.644404 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:28:14.644404 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:28:14.644404 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:28:14.644404 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:28:14.644404 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:28:14.644404 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87cd0cbd-547d-4e0e-a797-7971ce307b17 could not be found. Oct 01 04:28:14.644404 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:28:14.644404 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:28:14.644404 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:28:14.644404 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:28:14.644404 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:28:14.644404 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:28:14.644404 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:28:14.644404 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:28:14.644404 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87cd0cbd-547d-4e0e-a797-7971ce307b17 could not be found. Oct 01 04:28:14.644404 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:28:14.645960 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d6d74fbf-8688-4326-9edc-556da8672c43 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Returning 404 to user: Instance 87cd0cbd-547d-4e0e-a797-7971ce307b17 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:28:14.645960 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d6d74fbf-8688-4326-9edc-556da8672c43 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17" status: 404 len: 111 microversion: 2.1 time: 0.030708 Oct 01 04:28:14.645960 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 507/982] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:28:14 2022] GET /compute/v2.1/servers/87cd0cbd-547d-4e0e-a797-7971ce307b17 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:28:15.093527 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-aff01dbb-3248-4f1f-b92b-dd302977024f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:15.094053 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-aff01dbb-3248-4f1f-b92b-dd302977024f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:15.100588 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aff01dbb-3248-4f1f-b92b-dd302977024f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:15.101126 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aff01dbb-3248-4f1f-b92b-dd302977024f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:15.101576 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aff01dbb-3248-4f1f-b92b-dd302977024f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:15.102289 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aff01dbb-3248-4f1f-b92b-dd302977024f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:15.102762 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aff01dbb-3248-4f1f-b92b-dd302977024f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:15.103195 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-aff01dbb-3248-4f1f-b92b-dd302977024f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:15.117747 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-aff01dbb-3248-4f1f-b92b-dd302977024f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] HTTP exception thrown: Instance 1b31127e-af32-4116-90df-f27354ee55f4 could not be found. Oct 01 04:28:15.119504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-aff01dbb-3248-4f1f-b92b-dd302977024f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Request method failure captured: Oct 01 04:28:15.119504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: request: DELETE /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 HTTP/1.1 Oct 01 04:28:15.119504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept: application/json Oct 01 04:28:15.119504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept-Encoding: identity Oct 01 04:28:15.119504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Connection: close Oct 01 04:28:15.119504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Length: 0 Oct 01 04:28:15.119504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Type: application/json Oct 01 04:28:15.119504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Host: 10.222.0.26 Oct 01 04:28:15.119504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 01 04:28:15.119504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 01 04:28:15.119504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjN7_-6vOf5LAXMJpNxgHCXAL5Yp_KV-I0ygMkF8xEYZOdOvZKckxX5HUNO3pw108A69ZwDA0bYsnx9P5YHYocO16Z7ax6mNXSFOBYjPJMQdJY1ME4QGMgu0rxDHvGGJq-CjqrTfLFyN7kotOulhYPoCsLTqZiUqAg5_l6o0qdPQrD0SE Oct 01 04:28:15.119504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Id: None Oct 01 04:28:15.119504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Name: None Oct 01 04:28:15.119504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 01 04:28:15.119504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 01 04:28:15.119504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 01 04:28:15.119504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 01 04:28:15.119504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Id: 721dd52b82194e4d91113d4d688900ae Oct 01 04:28:15.119504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Name: tempest-TestVolumeBootPattern-774411632 Oct 01 04:28:15.119504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Role: reader,member Oct 01 04:28:15.119504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Roles: reader,member Oct 01 04:28:15.121141 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_721dd52b82194e4d91113d4d688900ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/721dd52b82194e4d91113d4d688900ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/721dd52b82194e4d91113d4d688900ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/721dd52b82194e4d91113d4d688900ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:28:15.121141 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant: tempest-TestVolumeBootPattern-774411632 Oct 01 04:28:15.121141 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Id: 721dd52b82194e4d91113d4d688900ae Oct 01 04:28:15.121141 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Name: tempest-TestVolumeBootPattern-774411632 Oct 01 04:28:15.121141 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User: tempest-TestVolumeBootPattern-774411632-project Oct 01 04:28:15.121141 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 01 04:28:15.121141 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 01 04:28:15.121141 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Id: dea6fd8e6a374cd5b12ec7d99f285203 Oct 01 04:28:15.121141 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Name: tempest-TestVolumeBootPattern-774411632-project Oct 01 04:28:15.121141 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: method: > Oct 01 04:28:15.121141 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: exception: Instance 1b31127e-af32-4116-90df-f27354ee55f4 could not be found. Oct 01 04:28:15.121141 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: action_args: {'id': '1b31127e-af32-4116-90df-f27354ee55f4'} Oct 01 04:28:15.122069 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:28:15.122069 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:28:15.122069 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:28:15.122069 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:28:15.122069 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:28:15.122069 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:28:15.122069 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:28:15.122069 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:28:15.122069 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:28:15.122069 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:28:15.122069 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b31127e-af32-4116-90df-f27354ee55f4 could not be found. Oct 01 04:28:15.122069 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:28:15.122069 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:28:15.122069 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:28:15.122069 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:28:15.122069 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:28:15.122069 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:28:15.122069 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:28:15.122069 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:28:15.122069 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:28:15.123556 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:28:15.123556 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 04:28:15.123556 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 04:28:15.123556 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 04:28:15.123556 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 04:28:15.123556 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:28:15.123556 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:28:15.123556 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:28:15.123556 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:28:15.123556 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b31127e-af32-4116-90df-f27354ee55f4 could not be found. Oct 01 04:28:15.123556 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:28:15.123556 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:28:15.123556 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:28:15.123556 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:28:15.123556 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:28:15.123556 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:28:15.123556 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:28:15.123556 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:28:15.123556 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b31127e-af32-4116-90df-f27354ee55f4 could not be found. Oct 01 04:28:15.123556 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:28:15.125046 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-aff01dbb-3248-4f1f-b92b-dd302977024f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Returning 404 to user: Instance 1b31127e-af32-4116-90df-f27354ee55f4 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:28:15.125046 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-aff01dbb-3248-4f1f-b92b-dd302977024f tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 404 len: 111 microversion: 2.1 time: 0.032011 Oct 01 04:28:15.125046 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 476/983] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 1 04:28:15 2022] DELETE /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:28:15.129889 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0cfaa896-dc9f-4d8f-acd5-21371c30016a tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:15.130508 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0cfaa896-dc9f-4d8f-acd5-21371c30016a tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] [instance: 1b31127e-af32-4116-90df-f27354ee55f4] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:15.136398 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0cfaa896-dc9f-4d8f-acd5-21371c30016a tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:15.136890 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0cfaa896-dc9f-4d8f-acd5-21371c30016a tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:15.137399 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0cfaa896-dc9f-4d8f-acd5-21371c30016a tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:15.138101 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0cfaa896-dc9f-4d8f-acd5-21371c30016a tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:15.138564 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0cfaa896-dc9f-4d8f-acd5-21371c30016a tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:15.138991 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0cfaa896-dc9f-4d8f-acd5-21371c30016a tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:15.152548 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-0cfaa896-dc9f-4d8f-acd5-21371c30016a tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] HTTP exception thrown: Instance 1b31127e-af32-4116-90df-f27354ee55f4 could not be found. Oct 01 04:28:15.154639 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0cfaa896-dc9f-4d8f-acd5-21371c30016a tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Request method failure captured: Oct 01 04:28:15.154639 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 HTTP/1.1 Oct 01 04:28:15.154639 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:28:15.154639 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:28:15.154639 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:28:15.154639 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 0 Oct 01 04:28:15.154639 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:28:15.154639 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:28:15.154639 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:28:15.154639 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:28:15.154639 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN7_-6vOf5LAXMJpNxgHCXAL5Yp_KV-I0ygMkF8xEYZOdOvZKckxX5HUNO3pw108A69ZwDA0bYsnx9P5YHYocO16Z7ax6mNXSFOBYjPJMQdJY1ME4QGMgu0rxDHvGGJq-CjqrTfLFyN7kotOulhYPoCsLTqZiUqAg5_l6o0qdPQrD0SE Oct 01 04:28:15.154639 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:28:15.154639 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:28:15.154639 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:28:15.154639 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:28:15.154639 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:28:15.154639 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:28:15.154639 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: 721dd52b82194e4d91113d4d688900ae Oct 01 04:28:15.154639 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-TestVolumeBootPattern-774411632 Oct 01 04:28:15.154639 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:28:15.154639 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:28:15.156267 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_721dd52b82194e4d91113d4d688900ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/721dd52b82194e4d91113d4d688900ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/721dd52b82194e4d91113d4d688900ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/721dd52b82194e4d91113d4d688900ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:28:15.156267 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-TestVolumeBootPattern-774411632 Oct 01 04:28:15.156267 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 721dd52b82194e4d91113d4d688900ae Oct 01 04:28:15.156267 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestVolumeBootPattern-774411632 Oct 01 04:28:15.156267 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-TestVolumeBootPattern-774411632-project Oct 01 04:28:15.156267 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:28:15.156267 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:28:15.156267 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: dea6fd8e6a374cd5b12ec7d99f285203 Oct 01 04:28:15.156267 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-TestVolumeBootPattern-774411632-project Oct 01 04:28:15.156267 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: > Oct 01 04:28:15.156267 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Instance 1b31127e-af32-4116-90df-f27354ee55f4 could not be found. Oct 01 04:28:15.156267 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'id': '1b31127e-af32-4116-90df-f27354ee55f4'} Oct 01 04:28:15.157217 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:28:15.157217 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:28:15.157217 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:28:15.157217 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:28:15.157217 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:28:15.157217 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:28:15.157217 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:28:15.157217 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:28:15.157217 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:28:15.157217 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:28:15.157217 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b31127e-af32-4116-90df-f27354ee55f4 could not be found. Oct 01 04:28:15.157217 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:28:15.157217 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:28:15.157217 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:28:15.157217 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:28:15.157217 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:28:15.157217 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:28:15.157217 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:28:15.157217 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:28:15.157217 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:28:15.158739 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:28:15.158739 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:28:15.158739 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:28:15.158739 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:28:15.158739 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:28:15.158739 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:28:15.158739 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:28:15.158739 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b31127e-af32-4116-90df-f27354ee55f4 could not be found. Oct 01 04:28:15.158739 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:28:15.158739 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:28:15.158739 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:28:15.158739 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:28:15.158739 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:28:15.158739 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:28:15.158739 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:28:15.158739 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:28:15.158739 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b31127e-af32-4116-90df-f27354ee55f4 could not be found. Oct 01 04:28:15.158739 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:28:15.160075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0cfaa896-dc9f-4d8f-acd5-21371c30016a tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Returning 404 to user: Instance 1b31127e-af32-4116-90df-f27354ee55f4 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:28:15.160075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0cfaa896-dc9f-4d8f-acd5-21371c30016a tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4" status: 404 len: 111 microversion: 2.1 time: 0.029986 Oct 01 04:28:15.160075 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 508/984] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:28:15 2022] GET /compute/v2.1/servers/1b31127e-af32-4116-90df-f27354ee55f4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:28:15.918398 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9f8d94d3-3190-4675-b334-ee930835eb80 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5de45126-a30a-4e71-819c-1580819e1b96"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:28:15.921612 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9f8d94d3-3190-4675-b334-ee930835eb80 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 132e0a82-5272-4ff5-a141-33f0cb0944a1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:15.923688 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 01 04:28:15.923820 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Sat Oct 1 04:28:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1/os-volume_attachments (ip 10.222.0.26) !!! Oct 01 04:28:15.929679 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f8d94d3-3190-4675-b334-ee930835eb80 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:15.930163 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f8d94d3-3190-4675-b334-ee930835eb80 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:15.930598 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f8d94d3-3190-4675-b334-ee930835eb80 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:15.931295 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f8d94d3-3190-4675-b334-ee930835eb80 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:15.931753 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f8d94d3-3190-4675-b334-ee930835eb80 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:15.932181 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9f8d94d3-3190-4675-b334-ee930835eb80 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:16.010649 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-9f8d94d3-3190-4675-b334-ee930835eb80 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] HTTP exception thrown: Invalid volume: volume 5de45126-a30a-4e71-819c-1580819e1b96 is already attached to instances: 132e0a82-5272-4ff5-a141-33f0cb0944a1 Oct 01 04:28:16.012256 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9f8d94d3-3190-4675-b334-ee930835eb80 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Request method failure captured: Oct 01 04:28:16.012256 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: request: POST /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1/os-volume_attachments HTTP/1.1 Oct 01 04:28:16.012256 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept: application/json Oct 01 04:28:16.012256 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept-Encoding: identity Oct 01 04:28:16.012256 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Connection: close Oct 01 04:28:16.012256 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Length: 74 Oct 01 04:28:16.012256 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Type: application/json Oct 01 04:28:16.012256 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Host: 10.222.0.26 Oct 01 04:28:16.012256 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 01 04:28:16.012256 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 01 04:28:16.012256 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjN8EwZiIdaSHgJefVWHSlZ0UU8OX8R0aPtB8r1Pr3nfRFZLn6johVmlyimBuO6m2htmIzgGcwibHj5pfyrNspEC0yv0MbvK2BKJDTuaMjl6PU4M8pcs1czjr2NKHPBvNTiXqfyyojseF__WWl_lh7hlPx5Xw0WdfDj8zF_1x1MH7EsUY Oct 01 04:28:16.012256 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Id: None Oct 01 04:28:16.012256 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Name: None Oct 01 04:28:16.012256 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 01 04:28:16.012256 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 01 04:28:16.012256 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 01 04:28:16.012256 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 01 04:28:16.012256 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Id: 57f927e7829a4172b9919b964a9e7c13 Oct 01 04:28:16.012256 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Name: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:28:16.012256 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Role: reader,member Oct 01 04:28:16.012256 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Roles: reader,member Oct 01 04:28:16.013717 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:28:16.013717 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:28:16.013717 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Id: 57f927e7829a4172b9919b964a9e7c13 Oct 01 04:28:16.013717 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:28:16.013717 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User: tempest-AttachVolumeNegativeTest-41085015-project Oct 01 04:28:16.013717 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 01 04:28:16.013717 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 01 04:28:16.013717 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Id: 0e30d69a25494d70bc094eb92c4f9bb0 Oct 01 04:28:16.013717 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Name: tempest-AttachVolumeNegativeTest-41085015-project Oct 01 04:28:16.013717 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Oct 01 04:28:16.013717 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {"volumeAttachment": {"volumeId": "5de45126-a30a-4e71-819c-1580819e1b96"}} Oct 01 04:28:16.013717 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: method: > Oct 01 04:28:16.014524 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: exception: Invalid volume: volume 5de45126-a30a-4e71-819c-1580819e1b96 is already attached to instances: 132e0a82-5272-4ff5-a141-33f0cb0944a1 Oct 01 04:28:16.014524 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: action_args: {'server_id': '132e0a82-5272-4ff5-a141-33f0cb0944a1', 'body': {'volumeAttachment': {'volumeId': '5de45126-a30a-4e71-819c-1580819e1b96'}}} Oct 01 04:28:16.014524 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:28:16.014524 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:28:16.014524 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 01 04:28:16.014524 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 01 04:28:16.014524 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 01 04:28:16.014524 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 01 04:28:16.014524 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 01 04:28:16.014524 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 01 04:28:16.014524 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 01 04:28:16.014524 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 01 04:28:16.014524 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 01 04:28:16.014524 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 01 04:28:16.014524 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5de45126-a30a-4e71-819c-1580819e1b96 is already attached to instances: 132e0a82-5272-4ff5-a141-33f0cb0944a1 Oct 01 04:28:16.014524 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:28:16.014524 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:28:16.014524 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:28:16.014524 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:28:16.015900 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:28:16.015900 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:28:16.015900 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:28:16.015900 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:28:16.015900 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:28:16.015900 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:28:16.015900 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 04:28:16.015900 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 04:28:16.015900 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 04:28:16.015900 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 04:28:16.015900 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 01 04:28:16.015900 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 01 04:28:16.015900 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 01 04:28:16.015900 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 01 04:28:16.015900 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5de45126-a30a-4e71-819c-1580819e1b96 is already attached to instances: 132e0a82-5272-4ff5-a141-33f0cb0944a1 Oct 01 04:28:16.015900 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:28:16.015900 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:28:16.015900 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:28:16.015900 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:28:16.015900 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:28:16.017882 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:28:16.017882 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:28:16.017882 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:28:16.017882 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5de45126-a30a-4e71-819c-1580819e1b96 is already attached to instances: 132e0a82-5272-4ff5-a141-33f0cb0944a1 Oct 01 04:28:16.017882 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:28:16.017882 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9f8d94d3-3190-4675-b334-ee930835eb80 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Returning 400 to user: Invalid volume: volume 5de45126-a30a-4e71-819c-1580819e1b96 is already attached to instances: 132e0a82-5272-4ff5-a141-33f0cb0944a1 {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:28:16.017882 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9f8d94d3-3190-4675-b334-ee930835eb80 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "POST /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099310 Oct 01 04:28:16.017882 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 477/985] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 1 04:28:15 2022] POST /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 01 04:28:16.079615 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9272bc44-b1df-47b6-9ffa-559d3e5b08f3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:16.080141 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9272bc44-b1df-47b6-9ffa-559d3e5b08f3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 132e0a82-5272-4ff5-a141-33f0cb0944a1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:16.086398 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9272bc44-b1df-47b6-9ffa-559d3e5b08f3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:16.086879 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9272bc44-b1df-47b6-9ffa-559d3e5b08f3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:16.087310 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9272bc44-b1df-47b6-9ffa-559d3e5b08f3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:16.087992 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9272bc44-b1df-47b6-9ffa-559d3e5b08f3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:16.088475 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9272bc44-b1df-47b6-9ffa-559d3e5b08f3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:16.088896 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9272bc44-b1df-47b6-9ffa-559d3e5b08f3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:16.173752 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-9272bc44-b1df-47b6-9ffa-559d3e5b08f3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lazy-loading 'services' on Instance uuid 132e0a82-5272-4ff5-a141-33f0cb0944a1 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:28:16.244419 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9272bc44-b1df-47b6-9ffa-559d3e5b08f3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "DELETE /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1/os-volume_attachments/5de45126-a30a-4e71-819c-1580819e1b96" status: 202 len: 0 microversion: 2.1 time: 0.168562 Oct 01 04:28:16.245044 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 509/986] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 1 04:28:16 2022] DELETE /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1/os-volume_attachments/5de45126-a30a-4e71-819c-1580819e1b96 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 04:28:16.253647 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-340dad00-7bcd-41b8-8911-325af735d885 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:16.255838 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-340dad00-7bcd-41b8-8911-325af735d885 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 132e0a82-5272-4ff5-a141-33f0cb0944a1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:16.263737 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-340dad00-7bcd-41b8-8911-325af735d885 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:16.264271 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-340dad00-7bcd-41b8-8911-325af735d885 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:16.264919 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-340dad00-7bcd-41b8-8911-325af735d885 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:16.265682 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-340dad00-7bcd-41b8-8911-325af735d885 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:16.266234 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-340dad00-7bcd-41b8-8911-325af735d885 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:16.266676 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-340dad00-7bcd-41b8-8911-325af735d885 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:16.302679 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-340dad00-7bcd-41b8-8911-325af735d885 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052852 Oct 01 04:28:16.303413 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 478/987] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 1 04:28:16 2022] GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:28:16.470030 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d91ba766-5ed7-4b4a-9424-34b799906630 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] Calling method '.version_select at 0x7fdfbe6b1700>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:16.491085 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d91ba766-5ed7-4b4a-9424-34b799906630 tempest-TestVolumeBootPattern-774411632 tempest-TestVolumeBootPattern-774411632-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1277045486" status: 202 len: 0 microversion: 2.1 time: 0.025829 Oct 01 04:28:16.495680 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 510/988] 10.222.0.26 () {58 vars in 1263 bytes} [Sat Oct 1 04:28:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1277045486 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 04:28:17.315288 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cc1bd2cd-094e-4fad-a789-f5ff4be152bc tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:17.317488 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cc1bd2cd-094e-4fad-a789-f5ff4be152bc tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 132e0a82-5272-4ff5-a141-33f0cb0944a1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:17.324017 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc1bd2cd-094e-4fad-a789-f5ff4be152bc tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:17.324510 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc1bd2cd-094e-4fad-a789-f5ff4be152bc tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:17.324976 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc1bd2cd-094e-4fad-a789-f5ff4be152bc tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:17.325681 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc1bd2cd-094e-4fad-a789-f5ff4be152bc tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:17.326146 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc1bd2cd-094e-4fad-a789-f5ff4be152bc tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:17.326576 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cc1bd2cd-094e-4fad-a789-f5ff4be152bc tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:17.358136 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cc1bd2cd-094e-4fad-a789-f5ff4be152bc tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044512 Oct 01 04:28:17.358136 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 479/989] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 1 04:28:17 2022] GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 04:28:17.421095 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-10e801a5-92c4-4d00-9185-e21035592e8d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:17.422288 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-10e801a5-92c4-4d00-9185-e21035592e8d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 132e0a82-5272-4ff5-a141-33f0cb0944a1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:17.429379 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10e801a5-92c4-4d00-9185-e21035592e8d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:17.430176 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10e801a5-92c4-4d00-9185-e21035592e8d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:17.430697 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10e801a5-92c4-4d00-9185-e21035592e8d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:17.431478 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10e801a5-92c4-4d00-9185-e21035592e8d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:17.432017 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10e801a5-92c4-4d00-9185-e21035592e8d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:17.432521 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-10e801a5-92c4-4d00-9185-e21035592e8d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:17.457299 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-10e801a5-92c4-4d00-9185-e21035592e8d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 132e0a82-5272-4ff5-a141-33f0cb0944a1] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 04:28:17.556503 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-10e801a5-92c4-4d00-9185-e21035592e8d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "DELETE /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1" status: 204 len: 0 microversion: 2.1 time: 0.139472 Oct 01 04:28:17.557127 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 511/990] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 1 04:28:17 2022] DELETE /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 04:28:17.566490 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-c867e816-bbaa-44b0-a9b9-a4e8b6228abc tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:17.567174 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-c867e816-bbaa-44b0-a9b9-a4e8b6228abc tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 132e0a82-5272-4ff5-a141-33f0cb0944a1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:17.573747 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c867e816-bbaa-44b0-a9b9-a4e8b6228abc tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:17.574244 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c867e816-bbaa-44b0-a9b9-a4e8b6228abc tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:17.574680 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c867e816-bbaa-44b0-a9b9-a4e8b6228abc tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:17.575389 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c867e816-bbaa-44b0-a9b9-a4e8b6228abc tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:17.575849 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c867e816-bbaa-44b0-a9b9-a4e8b6228abc tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:17.576273 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-c867e816-bbaa-44b0-a9b9-a4e8b6228abc tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:17.724874 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-c867e816-bbaa-44b0-a9b9-a4e8b6228abc tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:28:17.734456 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-c867e816-bbaa-44b0-a9b9-a4e8b6228abc tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1" status: 200 len: 1679 microversion: 2.1 time: 0.172760 Oct 01 04:28:17.735470 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 480/991] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:28:17 2022] GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1 => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:28:18.758531 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-cd46745f-4fe4-4ced-bf5c-484fca4d3e6f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:18.759215 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-cd46745f-4fe4-4ced-bf5c-484fca4d3e6f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 132e0a82-5272-4ff5-a141-33f0cb0944a1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:18.766159 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd46745f-4fe4-4ced-bf5c-484fca4d3e6f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:18.766713 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd46745f-4fe4-4ced-bf5c-484fca4d3e6f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:18.767503 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd46745f-4fe4-4ced-bf5c-484fca4d3e6f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:18.768558 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd46745f-4fe4-4ced-bf5c-484fca4d3e6f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:18.769090 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd46745f-4fe4-4ced-bf5c-484fca4d3e6f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:18.769633 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-cd46745f-4fe4-4ced-bf5c-484fca4d3e6f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:18.971177 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-cd46745f-4fe4-4ced-bf5c-484fca4d3e6f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:28:18.979223 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-cd46745f-4fe4-4ced-bf5c-484fca4d3e6f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1" status: 200 len: 1679 microversion: 2.1 time: 0.224930 Oct 01 04:28:18.980111 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 512/992] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:28:18 2022] GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1 => generated 1679 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:28:20.004168 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2486a8db-bcb7-4e14-8569-9bcafabf232b tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:20.004802 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2486a8db-bcb7-4e14-8569-9bcafabf232b tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 132e0a82-5272-4ff5-a141-33f0cb0944a1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:20.015356 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2486a8db-bcb7-4e14-8569-9bcafabf232b tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:20.015859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2486a8db-bcb7-4e14-8569-9bcafabf232b tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:20.016300 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2486a8db-bcb7-4e14-8569-9bcafabf232b tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:20.017291 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2486a8db-bcb7-4e14-8569-9bcafabf232b tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:20.017755 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2486a8db-bcb7-4e14-8569-9bcafabf232b tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:20.018181 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2486a8db-bcb7-4e14-8569-9bcafabf232b tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:20.024378 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-67b239a4-1448-42ff-84fa-7f5c852da89a req-df217fff-3969-40fe-8b3f-1e69c1ceb490 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "132e0a82-5272-4ff5-a141-33f0cb0944a1", "name": "network-vif-deleted", "tag": "5b469383-e557-431c-8ca1-77112c8a8607"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:28:20.036863 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-67b239a4-1448-42ff-84fa-7f5c852da89a req-df217fff-3969-40fe-8b3f-1e69c1ceb490 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:20.037531 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-67b239a4-1448-42ff-84fa-7f5c852da89a req-df217fff-3969-40fe-8b3f-1e69c1ceb490 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:20.039312 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-67b239a4-1448-42ff-84fa-7f5c852da89a req-df217fff-3969-40fe-8b3f-1e69c1ceb490 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:20.060257 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-67b239a4-1448-42ff-84fa-7f5c852da89a req-df217fff-3969-40fe-8b3f-1e69c1ceb490 service nova] Creating event network-vif-deleted:5b469383-e557-431c-8ca1-77112c8a8607 for instance 132e0a82-5272-4ff5-a141-33f0cb0944a1 on hv-cinder-86004 Oct 01 04:28:20.066801 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-67b239a4-1448-42ff-84fa-7f5c852da89a req-df217fff-3969-40fe-8b3f-1e69c1ceb490 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144414 Oct 01 04:28:20.078315 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 481/993] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:28:20.159489 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2486a8db-bcb7-4e14-8569-9bcafabf232b tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:28:20.173916 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2486a8db-bcb7-4e14-8569-9bcafabf232b tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1" status: 200 len: 1326 microversion: 2.1 time: 0.173737 Oct 01 04:28:20.176324 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 513/994] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:28:19 2022] GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1 => generated 1326 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:28:21.199181 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fa991e9b-e8aa-40b8-98a1-2b1145a979ce tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:21.201075 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fa991e9b-e8aa-40b8-98a1-2b1145a979ce tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 132e0a82-5272-4ff5-a141-33f0cb0944a1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:21.207708 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa991e9b-e8aa-40b8-98a1-2b1145a979ce tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:21.208199 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa991e9b-e8aa-40b8-98a1-2b1145a979ce tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:21.208635 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa991e9b-e8aa-40b8-98a1-2b1145a979ce tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:21.209362 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa991e9b-e8aa-40b8-98a1-2b1145a979ce tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:21.209827 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa991e9b-e8aa-40b8-98a1-2b1145a979ce tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:21.210262 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fa991e9b-e8aa-40b8-98a1-2b1145a979ce tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:21.223652 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-fa991e9b-e8aa-40b8-98a1-2b1145a979ce tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] HTTP exception thrown: Instance 132e0a82-5272-4ff5-a141-33f0cb0944a1 could not be found. Oct 01 04:28:21.225352 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fa991e9b-e8aa-40b8-98a1-2b1145a979ce tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Request method failure captured: Oct 01 04:28:21.225352 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1 HTTP/1.1 Oct 01 04:28:21.225352 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept: application/json Oct 01 04:28:21.225352 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept-Encoding: identity Oct 01 04:28:21.225352 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Connection: close Oct 01 04:28:21.225352 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Length: 0 Oct 01 04:28:21.225352 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Type: application/json Oct 01 04:28:21.225352 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Host: 10.222.0.26 Oct 01 04:28:21.225352 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 01 04:28:21.225352 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 01 04:28:21.225352 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjN8EwZiIdaSHgJefVWHSlZ0UU8OX8R0aPtB8r1Pr3nfRFZLn6johVmlyimBuO6m2htmIzgGcwibHj5pfyrNspEC0yv0MbvK2BKJDTuaMjl6PU4M8pcs1czjr2NKHPBvNTiXqfyyojseF__WWl_lh7hlPx5Xw0WdfDj8zF_1x1MH7EsUY Oct 01 04:28:21.225352 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Id: None Oct 01 04:28:21.225352 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Name: None Oct 01 04:28:21.225352 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 01 04:28:21.225352 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 01 04:28:21.225352 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 01 04:28:21.225352 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 01 04:28:21.225352 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Id: 57f927e7829a4172b9919b964a9e7c13 Oct 01 04:28:21.225352 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Name: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:28:21.225352 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Role: reader,member Oct 01 04:28:21.225352 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Roles: reader,member Oct 01 04:28:21.227057 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:28:21.227057 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:28:21.227057 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Id: 57f927e7829a4172b9919b964a9e7c13 Oct 01 04:28:21.227057 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:28:21.227057 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User: tempest-AttachVolumeNegativeTest-41085015-project Oct 01 04:28:21.227057 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 01 04:28:21.227057 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 01 04:28:21.227057 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Id: 0e30d69a25494d70bc094eb92c4f9bb0 Oct 01 04:28:21.227057 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Name: tempest-AttachVolumeNegativeTest-41085015-project Oct 01 04:28:21.227057 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: method: > Oct 01 04:28:21.227057 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: exception: Instance 132e0a82-5272-4ff5-a141-33f0cb0944a1 could not be found. Oct 01 04:28:21.227057 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: action_args: {'id': '132e0a82-5272-4ff5-a141-33f0cb0944a1'} Oct 01 04:28:21.227971 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:28:21.227971 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:28:21.227971 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:28:21.227971 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:28:21.227971 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:28:21.227971 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:28:21.227971 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:28:21.227971 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:28:21.227971 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:28:21.227971 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:28:21.227971 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 132e0a82-5272-4ff5-a141-33f0cb0944a1 could not be found. Oct 01 04:28:21.227971 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:28:21.227971 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:28:21.227971 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:28:21.227971 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:28:21.227971 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:28:21.227971 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:28:21.227971 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:28:21.227971 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:28:21.227971 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:28:21.229508 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:28:21.229508 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:28:21.229508 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:28:21.229508 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:28:21.229508 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:28:21.229508 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:28:21.229508 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:28:21.229508 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 132e0a82-5272-4ff5-a141-33f0cb0944a1 could not be found. Oct 01 04:28:21.229508 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:28:21.229508 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:28:21.229508 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:28:21.229508 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:28:21.229508 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:28:21.229508 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:28:21.229508 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:28:21.229508 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:28:21.229508 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 132e0a82-5272-4ff5-a141-33f0cb0944a1 could not be found. Oct 01 04:28:21.229508 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:28:21.230826 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fa991e9b-e8aa-40b8-98a1-2b1145a979ce tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Returning 404 to user: Instance 132e0a82-5272-4ff5-a141-33f0cb0944a1 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:28:21.230826 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fa991e9b-e8aa-40b8-98a1-2b1145a979ce tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1" status: 404 len: 111 microversion: 2.1 time: 0.031947 Oct 01 04:28:21.230826 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 482/995] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:28:21 2022] GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:28:21.235884 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f348ca88-31ce-45c0-a7b2-798a54a3d81b tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '.version_select at 0x7fdfbe81e550>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:21.256865 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f348ca88-31ce-45c0-a7b2-798a54a3d81b tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-247447907" status: 202 len: 0 microversion: 2.1 time: 0.024646 Oct 01 04:28:21.257474 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 514/996] 10.222.0.26 () {58 vars in 1218 bytes} [Sat Oct 1 04:28:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-247447907 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 04:28:22.193223 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-2ac307c1-ef3f-4556-b19f-7246396ae089 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Action: 'create', calling method: .version_select at 0x7fdfbe8e8af0>, body: {"keypair": {"name": "tempest-keypair-1119198569", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPf90N/RT7K0eMtrZzKHFDf2gJjToy9Ofw29QXqhb0ZazeUpewZkn8cmU+umGbN+SnwCBAYwJf8f9KuLuHbbseEhH6fBYHJRLKdC4xu77IznTL7SSCnnLrUG00br3RsT0g=="}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:28:22.209479 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-2ac307c1-ef3f-4556-b19f-7246396ae089 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Getting quotas for project 57f927e7829a4172b9919b964a9e7c13. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:28:22.213220 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.quota [None req-2ac307c1-ef3f-4556-b19f-7246396ae089 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Getting quotas for user 0e30d69a25494d70bc094eb92c4f9bb0 and project 57f927e7829a4172b9919b964a9e7c13. Resources: {'key_pairs'} {{(pid=120597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:28:22.235635 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-2ac307c1-ef3f-4556-b19f-7246396ae089 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046230 Oct 01 04:28:22.236651 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 483/997] 10.222.0.26 () {60 vars in 1159 bytes} [Sat Oct 1 04:28:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:28:23.787332 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d01962dc-2a52-4416-97ec-8493cbf59a35 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-538929831", "imageRef": "c63d52d7-4e3d-40cf-a8b5-59a2d027d793", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bddd7754-f392-4f22-b92b-c088917d60a6"}], "security_groups": [{"name": "tempest-securitygroup--409578017"}], "key_name": "tempest-keypair-1119198569", "user_data": "}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:28:23.892701 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-d01962dc-2a52-4416-97ec-8493cbf59a35 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] validate_networks() for [('bddd7754-f392-4f22-b92b-c088917d60a6', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 04:28:24.297456 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d01962dc-2a52-4416-97ec-8493cbf59a35 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 04:28:24.298470 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d01962dc-2a52-4416-97ec-8493cbf59a35 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 04:28:24.299152 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d01962dc-2a52-4416-97ec-8493cbf59a35 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 04:28:24.299568 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d01962dc-2a52-4416-97ec-8493cbf59a35 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 04:28:24.299986 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-d01962dc-2a52-4416-97ec-8493cbf59a35 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 04:28:24.308811 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d01962dc-2a52-4416-97ec-8493cbf59a35 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:24.309870 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d01962dc-2a52-4416-97ec-8493cbf59a35 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:24.310428 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d01962dc-2a52-4416-97ec-8493cbf59a35 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:24.311289 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d01962dc-2a52-4416-97ec-8493cbf59a35 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:24.311751 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d01962dc-2a52-4416-97ec-8493cbf59a35 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:24.312187 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d01962dc-2a52-4416-97ec-8493cbf59a35 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:24.332260 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-d01962dc-2a52-4416-97ec-8493cbf59a35 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Getting quotas for project 57f927e7829a4172b9919b964a9e7c13. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:28:24.337253 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-d01962dc-2a52-4416-97ec-8493cbf59a35 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Getting quotas for user 0e30d69a25494d70bc094eb92c4f9bb0 and project 57f927e7829a4172b9919b964a9e7c13. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:28:24.350641 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d01962dc-2a52-4416-97ec-8493cbf59a35 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 04:28:24.353087 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d01962dc-2a52-4416-97ec-8493cbf59a35 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 67294823-eb18-482e-86fa-bf3371a5ee32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c63d52d7-4e3d-40cf-a8b5-59a2d027d793',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 04:28:24.411207 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d01962dc-2a52-4416-97ec-8493cbf59a35 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.628774 Oct 01 04:28:24.412199 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 515/998] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 1 04:28:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 04:28:24.424211 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-499394cc-66c3-47b5-a1d5-351d29876dd2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:24.425572 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-499394cc-66c3-47b5-a1d5-351d29876dd2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 67294823-eb18-482e-86fa-bf3371a5ee32] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:24.525349 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-499394cc-66c3-47b5-a1d5-351d29876dd2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:28:24.533255 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-499394cc-66c3-47b5-a1d5-351d29876dd2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32" status: 200 len: 1241 microversion: 2.1 time: 0.113015 Oct 01 04:28:24.533835 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 484/999] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:28:24 2022] GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32 => generated 1241 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:28:25.557600 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-255b1c8e-40fc-45d3-a1a9-4f7b6984e469 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:25.558495 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-255b1c8e-40fc-45d3-a1a9-4f7b6984e469 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 67294823-eb18-482e-86fa-bf3371a5ee32] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:25.565834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-255b1c8e-40fc-45d3-a1a9-4f7b6984e469 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:25.566411 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-255b1c8e-40fc-45d3-a1a9-4f7b6984e469 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:25.566844 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-255b1c8e-40fc-45d3-a1a9-4f7b6984e469 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:25.567577 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-255b1c8e-40fc-45d3-a1a9-4f7b6984e469 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:25.568042 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-255b1c8e-40fc-45d3-a1a9-4f7b6984e469 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:25.568517 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-255b1c8e-40fc-45d3-a1a9-4f7b6984e469 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:25.637248 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-255b1c8e-40fc-45d3-a1a9-4f7b6984e469 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:28:25.645355 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-255b1c8e-40fc-45d3-a1a9-4f7b6984e469 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32" status: 200 len: 1299 microversion: 2.1 time: 0.092377 Oct 01 04:28:25.645943 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 516/1000] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:28:25 2022] GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32 => generated 1299 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:28:26.669266 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f1b299ee-419e-4708-a230-bbd1af766db3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:26.669880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f1b299ee-419e-4708-a230-bbd1af766db3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 67294823-eb18-482e-86fa-bf3371a5ee32] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:26.676461 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1b299ee-419e-4708-a230-bbd1af766db3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:26.676974 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1b299ee-419e-4708-a230-bbd1af766db3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:26.677417 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1b299ee-419e-4708-a230-bbd1af766db3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:26.678111 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1b299ee-419e-4708-a230-bbd1af766db3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:26.678568 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1b299ee-419e-4708-a230-bbd1af766db3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:26.678987 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f1b299ee-419e-4708-a230-bbd1af766db3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:26.812583 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-f1b299ee-419e-4708-a230-bbd1af766db3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:28:26.816209 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:28:26.824541 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-062bd085-e51e-4b78-864b-50d87ead01c4 req-9c3ff6e2-9892-4107-96e5-e671b339d1fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67294823-eb18-482e-86fa-bf3371a5ee32", "tag": "b26672bb-dbc8-4e52-a5fb-c61d98b762c2"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:28:26.832652 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f1b299ee-419e-4708-a230-bbd1af766db3 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32" status: 200 len: 1366 microversion: 2.1 time: 0.167573 Oct 01 04:28:26.833362 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 485/1001] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:28:26 2022] GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:28:26.841572 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-062bd085-e51e-4b78-864b-50d87ead01c4 req-9c3ff6e2-9892-4107-96e5-e671b339d1fe service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:26.842311 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-062bd085-e51e-4b78-864b-50d87ead01c4 req-9c3ff6e2-9892-4107-96e5-e671b339d1fe service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:26.842895 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-062bd085-e51e-4b78-864b-50d87ead01c4 req-9c3ff6e2-9892-4107-96e5-e671b339d1fe service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:26.858990 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-062bd085-e51e-4b78-864b-50d87ead01c4 req-9c3ff6e2-9892-4107-96e5-e671b339d1fe service nova] Creating event network-changed:b26672bb-dbc8-4e52-a5fb-c61d98b762c2 for instance 67294823-eb18-482e-86fa-bf3371a5ee32 on hv-cinder-86004 Oct 01 04:28:26.864020 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-062bd085-e51e-4b78-864b-50d87ead01c4 req-9c3ff6e2-9892-4107-96e5-e671b339d1fe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043052 Oct 01 04:28:26.864617 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 517/1002] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:28:27.858703 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-91af87da-8828-4097-9bbd-ebcbf6fd94e0 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:27.859321 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-91af87da-8828-4097-9bbd-ebcbf6fd94e0 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 67294823-eb18-482e-86fa-bf3371a5ee32] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:27.866682 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91af87da-8828-4097-9bbd-ebcbf6fd94e0 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:27.867169 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91af87da-8828-4097-9bbd-ebcbf6fd94e0 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:27.867602 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91af87da-8828-4097-9bbd-ebcbf6fd94e0 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:27.868293 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91af87da-8828-4097-9bbd-ebcbf6fd94e0 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:27.868749 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91af87da-8828-4097-9bbd-ebcbf6fd94e0 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:27.869218 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-91af87da-8828-4097-9bbd-ebcbf6fd94e0 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:27.999906 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-91af87da-8828-4097-9bbd-ebcbf6fd94e0 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:28:28.007797 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-91af87da-8828-4097-9bbd-ebcbf6fd94e0 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32" status: 200 len: 1366 microversion: 2.1 time: 0.154305 Oct 01 04:28:28.008409 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 486/1003] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:28:27 2022] GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:28:29.032430 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-57a95060-efee-46ac-944a-d144abe1a9de tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:29.033177 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-57a95060-efee-46ac-944a-d144abe1a9de tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 67294823-eb18-482e-86fa-bf3371a5ee32] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:29.039326 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57a95060-efee-46ac-944a-d144abe1a9de tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:29.039807 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57a95060-efee-46ac-944a-d144abe1a9de tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:29.040236 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57a95060-efee-46ac-944a-d144abe1a9de tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:29.040944 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57a95060-efee-46ac-944a-d144abe1a9de tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:29.041400 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57a95060-efee-46ac-944a-d144abe1a9de tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:29.041817 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-57a95060-efee-46ac-944a-d144abe1a9de tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:29.172646 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-57a95060-efee-46ac-944a-d144abe1a9de tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:28:29.180279 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-57a95060-efee-46ac-944a-d144abe1a9de tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32" status: 200 len: 1366 microversion: 2.1 time: 0.152720 Oct 01 04:28:29.180844 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 518/1004] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:28:29 2022] GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:28:30.203411 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-b10146cb-531c-41c8-a9f0-cfef952eaf94 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:30.204029 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-b10146cb-531c-41c8-a9f0-cfef952eaf94 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 67294823-eb18-482e-86fa-bf3371a5ee32] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:30.210441 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b10146cb-531c-41c8-a9f0-cfef952eaf94 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:30.210931 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b10146cb-531c-41c8-a9f0-cfef952eaf94 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:30.211375 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b10146cb-531c-41c8-a9f0-cfef952eaf94 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:30.212072 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b10146cb-531c-41c8-a9f0-cfef952eaf94 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:30.212533 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b10146cb-531c-41c8-a9f0-cfef952eaf94 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:30.213012 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-b10146cb-531c-41c8-a9f0-cfef952eaf94 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:30.339215 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-b10146cb-531c-41c8-a9f0-cfef952eaf94 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:28:30.347597 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-b10146cb-531c-41c8-a9f0-cfef952eaf94 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32" status: 200 len: 1366 microversion: 2.1 time: 0.148118 Oct 01 04:28:30.348161 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 487/1005] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:28:30 2022] GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:28:31.370637 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d528514c-9ae9-4b42-8fae-ec614ca51c4c tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:31.371394 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d528514c-9ae9-4b42-8fae-ec614ca51c4c tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 67294823-eb18-482e-86fa-bf3371a5ee32] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:31.378150 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d528514c-9ae9-4b42-8fae-ec614ca51c4c tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:31.378633 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d528514c-9ae9-4b42-8fae-ec614ca51c4c tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:31.379064 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d528514c-9ae9-4b42-8fae-ec614ca51c4c tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:31.379751 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d528514c-9ae9-4b42-8fae-ec614ca51c4c tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:31.380204 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d528514c-9ae9-4b42-8fae-ec614ca51c4c tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:31.380906 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d528514c-9ae9-4b42-8fae-ec614ca51c4c tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:31.484405 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-78371946-ad80-40ae-999f-e1488d31b019 req-68750273-c7b3-4a52-9dfc-e4b776f80f10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67294823-eb18-482e-86fa-bf3371a5ee32", "name": "network-vif-plugged", "status": "completed", "tag": "b26672bb-dbc8-4e52-a5fb-c61d98b762c2"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:28:31.495417 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-78371946-ad80-40ae-999f-e1488d31b019 req-68750273-c7b3-4a52-9dfc-e4b776f80f10 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:31.495909 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-78371946-ad80-40ae-999f-e1488d31b019 req-68750273-c7b3-4a52-9dfc-e4b776f80f10 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:31.496343 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-78371946-ad80-40ae-999f-e1488d31b019 req-68750273-c7b3-4a52-9dfc-e4b776f80f10 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:31.507547 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-78371946-ad80-40ae-999f-e1488d31b019 req-68750273-c7b3-4a52-9dfc-e4b776f80f10 service nova] Creating event network-vif-plugged:b26672bb-dbc8-4e52-a5fb-c61d98b762c2 for instance 67294823-eb18-482e-86fa-bf3371a5ee32 on hv-cinder-86004 Oct 01 04:28:31.514536 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-78371946-ad80-40ae-999f-e1488d31b019 req-68750273-c7b3-4a52-9dfc-e4b776f80f10 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034118 Oct 01 04:28:31.516000 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 488/1006] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:28:31.522205 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d528514c-9ae9-4b42-8fae-ec614ca51c4c tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:28:31.525754 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:28:31.533552 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d528514c-9ae9-4b42-8fae-ec614ca51c4c tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32" status: 200 len: 1366 microversion: 2.1 time: 0.166691 Oct 01 04:28:31.549153 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 519/1007] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:28:31 2022] GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:28:32.557786 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-afd19f09-35f1-4c2f-95e5-d31932241987 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:32.558488 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-afd19f09-35f1-4c2f-95e5-d31932241987 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 67294823-eb18-482e-86fa-bf3371a5ee32] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:32.564793 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afd19f09-35f1-4c2f-95e5-d31932241987 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:32.565314 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afd19f09-35f1-4c2f-95e5-d31932241987 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:32.565747 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afd19f09-35f1-4c2f-95e5-d31932241987 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:32.566431 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afd19f09-35f1-4c2f-95e5-d31932241987 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:32.566886 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afd19f09-35f1-4c2f-95e5-d31932241987 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:32.567311 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-afd19f09-35f1-4c2f-95e5-d31932241987 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:32.695866 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-afd19f09-35f1-4c2f-95e5-d31932241987 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:28:32.705563 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-afd19f09-35f1-4c2f-95e5-d31932241987 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32" status: 200 len: 1366 microversion: 2.1 time: 0.152375 Oct 01 04:28:32.708268 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 489/1008] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:28:32 2022] GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:28:33.731884 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-39984b1f-e8d3-403f-ae9a-9de7447f8599 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:33.732522 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-39984b1f-e8d3-403f-ae9a-9de7447f8599 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 67294823-eb18-482e-86fa-bf3371a5ee32] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:33.735959 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:28:33.740197 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39984b1f-e8d3-403f-ae9a-9de7447f8599 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:33.740688 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39984b1f-e8d3-403f-ae9a-9de7447f8599 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:33.741166 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39984b1f-e8d3-403f-ae9a-9de7447f8599 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:33.741866 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39984b1f-e8d3-403f-ae9a-9de7447f8599 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:33.742327 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39984b1f-e8d3-403f-ae9a-9de7447f8599 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:33.742759 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-39984b1f-e8d3-403f-ae9a-9de7447f8599 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:33.874014 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-39984b1f-e8d3-403f-ae9a-9de7447f8599 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:28:33.881615 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-39984b1f-e8d3-403f-ae9a-9de7447f8599 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32" status: 200 len: 1555 microversion: 2.1 time: 0.154994 Oct 01 04:28:33.882184 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 520/1009] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:28:33 2022] GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:28:33.905597 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-39771b32-39f1-4fb2-a99c-20977531ec6c tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:33.906112 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-39771b32-39f1-4fb2-a99c-20977531ec6c tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 67294823-eb18-482e-86fa-bf3371a5ee32] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:33.908494 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:28:33.913657 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39771b32-39f1-4fb2-a99c-20977531ec6c tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:33.914153 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39771b32-39f1-4fb2-a99c-20977531ec6c tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:33.914592 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39771b32-39f1-4fb2-a99c-20977531ec6c tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:33.915294 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39771b32-39f1-4fb2-a99c-20977531ec6c tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:33.915784 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39771b32-39f1-4fb2-a99c-20977531ec6c tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:33.916209 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-39771b32-39f1-4fb2-a99c-20977531ec6c tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:34.000706 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-39771b32-39f1-4fb2-a99c-20977531ec6c tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099777 Oct 01 04:28:34.001331 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 490/1010] 10.222.0.26 () {58 vars in 1275 bytes} [Sat Oct 1 04:28:33 2022] GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:28:35.127500 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-b2af4a6a-edb0-4968-b60a-42ac3dfbd49d req-defa8820-20b5-493e-bfac-d6e5d091dd8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67294823-eb18-482e-86fa-bf3371a5ee32", "tag": "b26672bb-dbc8-4e52-a5fb-c61d98b762c2"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:28:35.132774 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:28:35.133496 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:28:35.141810 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b2af4a6a-edb0-4968-b60a-42ac3dfbd49d req-defa8820-20b5-493e-bfac-d6e5d091dd8c service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:35.142551 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b2af4a6a-edb0-4968-b60a-42ac3dfbd49d req-defa8820-20b5-493e-bfac-d6e5d091dd8c service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:35.142984 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-b2af4a6a-edb0-4968-b60a-42ac3dfbd49d req-defa8820-20b5-493e-bfac-d6e5d091dd8c service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:35.154476 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-b2af4a6a-edb0-4968-b60a-42ac3dfbd49d req-defa8820-20b5-493e-bfac-d6e5d091dd8c service nova] Creating event network-changed:b26672bb-dbc8-4e52-a5fb-c61d98b762c2 for instance 67294823-eb18-482e-86fa-bf3371a5ee32 on hv-cinder-86004 Oct 01 04:28:35.159906 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-b2af4a6a-edb0-4968-b60a-42ac3dfbd49d req-defa8820-20b5-493e-bfac-d6e5d091dd8c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036678 Oct 01 04:28:35.160503 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 521/1011] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:28:44.612722 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=6 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:28:44.618721 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-7727bdb2-e30c-475c-aef4-aa26e33fbf26 req-f4f1c80b-2bac-47e3-8519-7c2f6497da45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2af93c94-483f-4f6d-a017-d45ef01bac8d", "tag": "ff800efd-217a-4aea-84a5-e5f05dd17b62"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:28:44.622588 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:28:44.623407 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=24 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:28:44.627271 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-f4b24526-0a12-4e7c-a70a-69dfef437aa9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:44.627765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f4b24526-0a12-4e7c-a70a-69dfef437aa9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:44.639808 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-7727bdb2-e30c-475c-aef4-aa26e33fbf26 req-f4f1c80b-2bac-47e3-8519-7c2f6497da45 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:44.640011 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4b24526-0a12-4e7c-a70a-69dfef437aa9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:44.640298 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-7727bdb2-e30c-475c-aef4-aa26e33fbf26 req-f4f1c80b-2bac-47e3-8519-7c2f6497da45 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:44.640427 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4b24526-0a12-4e7c-a70a-69dfef437aa9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:44.640737 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-7727bdb2-e30c-475c-aef4-aa26e33fbf26 req-f4f1c80b-2bac-47e3-8519-7c2f6497da45 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:44.640860 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4b24526-0a12-4e7c-a70a-69dfef437aa9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:44.641530 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4b24526-0a12-4e7c-a70a-69dfef437aa9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:44.641986 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4b24526-0a12-4e7c-a70a-69dfef437aa9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:44.642671 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-f4b24526-0a12-4e7c-a70a-69dfef437aa9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:44.652218 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-7727bdb2-e30c-475c-aef4-aa26e33fbf26 req-f4f1c80b-2bac-47e3-8519-7c2f6497da45 service nova] Creating event network-changed:ff800efd-217a-4aea-84a5-e5f05dd17b62 for instance 2af93c94-483f-4f6d-a017-d45ef01bac8d on hv-cinder-86004 Oct 01 04:28:44.658146 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-7727bdb2-e30c-475c-aef4-aa26e33fbf26 req-f4f1c80b-2bac-47e3-8519-7c2f6497da45 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043416 Oct 01 04:28:44.658746 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 522/1012] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:28:44.671054 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-f4b24526-0a12-4e7c-a70a-69dfef437aa9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 04:28:44.760944 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-f4b24526-0a12-4e7c-a70a-69dfef437aa9 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 204 len: 0 microversion: 2.1 time: 0.148556 Oct 01 04:28:44.762023 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 491/1013] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 1 04:28:44 2022] DELETE /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 04:28:44.771316 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6fc27f39-3590-42c8-bea0-86a8ce4f5ea2 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:44.772030 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6fc27f39-3590-42c8-bea0-86a8ce4f5ea2 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:44.778415 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6fc27f39-3590-42c8-bea0-86a8ce4f5ea2 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:44.779891 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6fc27f39-3590-42c8-bea0-86a8ce4f5ea2 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:44.780326 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6fc27f39-3590-42c8-bea0-86a8ce4f5ea2 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:44.781077 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6fc27f39-3590-42c8-bea0-86a8ce4f5ea2 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:44.781541 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6fc27f39-3590-42c8-bea0-86a8ce4f5ea2 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:44.781972 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6fc27f39-3590-42c8-bea0-86a8ce4f5ea2 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:44.924361 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-6fc27f39-3590-42c8-bea0-86a8ce4f5ea2 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:28:44.932356 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6fc27f39-3590-42c8-bea0-86a8ce4f5ea2 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1569 microversion: 2.1 time: 0.165549 Oct 01 04:28:44.932940 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 523/1014] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:28:44 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:28:45.956614 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-8fbe347d-0307-4f89-838d-ea96fc669bfd tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:45.957337 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-8fbe347d-0307-4f89-838d-ea96fc669bfd tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:45.963674 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fbe347d-0307-4f89-838d-ea96fc669bfd tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:45.964155 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fbe347d-0307-4f89-838d-ea96fc669bfd tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:45.964596 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fbe347d-0307-4f89-838d-ea96fc669bfd tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:45.965315 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fbe347d-0307-4f89-838d-ea96fc669bfd tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:45.965771 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fbe347d-0307-4f89-838d-ea96fc669bfd tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:45.966923 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-8fbe347d-0307-4f89-838d-ea96fc669bfd tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:46.101852 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-8fbe347d-0307-4f89-838d-ea96fc669bfd tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:28:46.109478 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-8fbe347d-0307-4f89-838d-ea96fc669bfd tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1569 microversion: 2.1 time: 0.157108 Oct 01 04:28:46.110042 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 492/1015] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:28:45 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:28:46.717570 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-a681824f-1625-4db7-aa2e-a0463f6cb24e req-3fabeb75-f04a-4f0a-b671-69f92399fd4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2af93c94-483f-4f6d-a017-d45ef01bac8d", "name": "network-vif-deleted", "tag": "ff800efd-217a-4aea-84a5-e5f05dd17b62"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:28:46.727845 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a681824f-1625-4db7-aa2e-a0463f6cb24e req-3fabeb75-f04a-4f0a-b671-69f92399fd4e service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:46.728332 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a681824f-1625-4db7-aa2e-a0463f6cb24e req-3fabeb75-f04a-4f0a-b671-69f92399fd4e service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:46.728766 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-a681824f-1625-4db7-aa2e-a0463f6cb24e req-3fabeb75-f04a-4f0a-b671-69f92399fd4e service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:46.741374 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-a681824f-1625-4db7-aa2e-a0463f6cb24e req-3fabeb75-f04a-4f0a-b671-69f92399fd4e service nova] Creating event network-vif-deleted:ff800efd-217a-4aea-84a5-e5f05dd17b62 for instance 2af93c94-483f-4f6d-a017-d45ef01bac8d on hv-cinder-86004 Oct 01 04:28:46.746305 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-a681824f-1625-4db7-aa2e-a0463f6cb24e req-3fabeb75-f04a-4f0a-b671-69f92399fd4e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032887 Oct 01 04:28:46.746890 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 524/1016] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:28:47.132742 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-cb9e7985-6938-44da-ab66-5184aa322d13 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:47.133411 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-cb9e7985-6938-44da-ab66-5184aa322d13 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:47.140686 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb9e7985-6938-44da-ab66-5184aa322d13 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:47.141304 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb9e7985-6938-44da-ab66-5184aa322d13 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:47.141976 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb9e7985-6938-44da-ab66-5184aa322d13 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:47.142958 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb9e7985-6938-44da-ab66-5184aa322d13 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:47.143442 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb9e7985-6938-44da-ab66-5184aa322d13 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:47.143880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb9e7985-6938-44da-ab66-5184aa322d13 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:47.178052 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb9e7985-6938-44da-ab66-5184aa322d13 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:47.178581 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb9e7985-6938-44da-ab66-5184aa322d13 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:47.179047 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-cb9e7985-6938-44da-ab66-5184aa322d13 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:47.180320 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-cb9e7985-6938-44da-ab66-5184aa322d13 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lazy-loading 'fault' on Instance uuid 2af93c94-483f-4f6d-a017-d45ef01bac8d {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:28:47.222135 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-cb9e7985-6938-44da-ab66-5184aa322d13 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944a3ab108184d5ab8784e21805f9873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eda12202e6f439b96a87a81d7531503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:28:47.229930 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-cb9e7985-6938-44da-ab66-5184aa322d13 tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 200 len: 1224 microversion: 2.1 time: 0.101176 Oct 01 04:28:47.230494 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 493/1017] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:28:47 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:28:48.253996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9c005121-7da9-4523-a1a6-f38fbb0f9f6d tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:48.254621 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9c005121-7da9-4523-a1a6-f38fbb0f9f6d tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] [instance: 2af93c94-483f-4f6d-a017-d45ef01bac8d] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:28:48.260728 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c005121-7da9-4523-a1a6-f38fbb0f9f6d tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:48.261242 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c005121-7da9-4523-a1a6-f38fbb0f9f6d tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:48.261673 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c005121-7da9-4523-a1a6-f38fbb0f9f6d tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:48.262357 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c005121-7da9-4523-a1a6-f38fbb0f9f6d tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:28:48.262818 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c005121-7da9-4523-a1a6-f38fbb0f9f6d tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:28:48.263245 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9c005121-7da9-4523-a1a6-f38fbb0f9f6d tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:28:48.276322 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-9c005121-7da9-4523-a1a6-f38fbb0f9f6d tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] HTTP exception thrown: Instance 2af93c94-483f-4f6d-a017-d45ef01bac8d could not be found. Oct 01 04:28:48.277963 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9c005121-7da9-4523-a1a6-f38fbb0f9f6d tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Request method failure captured: Oct 01 04:28:48.277963 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d HTTP/1.1 Oct 01 04:28:48.277963 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:28:48.277963 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:28:48.277963 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:28:48.277963 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 0 Oct 01 04:28:48.277963 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:28:48.277963 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:28:48.277963 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:28:48.277963 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:28:48.277963 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN8D1zfK1ZM7gVUreCfwtI6ZMviecA-7QVxudynTMxR_P3nxNtW066J2EbCXpY5vVx6vdwWe8DYCYLb4Dw2YhdAPSFThi5Qf6NBa_7vIOieWlO7JI8FK34sJYu844cyD-H5Ba5BKhlVosVi8lOfWB7Rjsh6aeLUk3EF9dD5zH7tWbrik Oct 01 04:28:48.277963 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:28:48.277963 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:28:48.277963 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:28:48.277963 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:28:48.277963 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:28:48.277963 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:28:48.277963 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: 1eda12202e6f439b96a87a81d7531503 Oct 01 04:28:48.277963 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-TestShelveInstance-338113509 Oct 01 04:28:48.277963 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:28:48.277963 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:28:48.280437 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1eda12202e6f439b96a87a81d7531503"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1eda12202e6f439b96a87a81d7531503"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1eda12202e6f439b96a87a81d7531503"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1eda12202e6f439b96a87a81d7531503"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:28:48.280437 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-TestShelveInstance-338113509 Oct 01 04:28:48.280437 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 1eda12202e6f439b96a87a81d7531503 Oct 01 04:28:48.280437 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-TestShelveInstance-338113509 Oct 01 04:28:48.280437 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-TestShelveInstance-338113509-project Oct 01 04:28:48.280437 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:28:48.280437 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:28:48.280437 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: 944a3ab108184d5ab8784e21805f9873 Oct 01 04:28:48.280437 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-TestShelveInstance-338113509-project Oct 01 04:28:48.280437 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: > Oct 01 04:28:48.280437 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Instance 2af93c94-483f-4f6d-a017-d45ef01bac8d could not be found. Oct 01 04:28:48.280437 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'id': '2af93c94-483f-4f6d-a017-d45ef01bac8d'} Oct 01 04:28:48.281301 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:28:48.281301 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:28:48.281301 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:28:48.281301 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:28:48.281301 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:28:48.281301 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:28:48.281301 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:28:48.281301 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:28:48.281301 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:28:48.281301 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:28:48.281301 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2af93c94-483f-4f6d-a017-d45ef01bac8d could not be found. Oct 01 04:28:48.281301 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:28:48.281301 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:28:48.281301 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:28:48.281301 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:28:48.281301 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:28:48.281301 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:28:48.281301 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:28:48.281301 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:28:48.281301 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:28:48.282705 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:28:48.282705 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:28:48.282705 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:28:48.282705 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:28:48.282705 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:28:48.282705 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:28:48.282705 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:28:48.282705 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2af93c94-483f-4f6d-a017-d45ef01bac8d could not be found. Oct 01 04:28:48.282705 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:28:48.282705 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:28:48.282705 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:28:48.282705 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:28:48.282705 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:28:48.282705 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:28:48.282705 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:28:48.282705 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:28:48.282705 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2af93c94-483f-4f6d-a017-d45ef01bac8d could not be found. Oct 01 04:28:48.282705 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:28:48.283908 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9c005121-7da9-4523-a1a6-f38fbb0f9f6d tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Returning 404 to user: Instance 2af93c94-483f-4f6d-a017-d45ef01bac8d could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:28:48.283908 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9c005121-7da9-4523-a1a6-f38fbb0f9f6d tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d" status: 404 len: 111 microversion: 2.1 time: 0.030771 Oct 01 04:28:48.283908 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 525/1018] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:28:48 2022] GET /compute/v2.1/servers/2af93c94-483f-4f6d-a017-d45ef01bac8d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:28:48.441227 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-33fee864-e265-4792-92a4-fc58c27977fb tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] Calling method '.version_select at 0x7fdfbe7d11f0>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:28:48.461527 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-33fee864-e265-4792-92a4-fc58c27977fb tempest-TestShelveInstance-338113509 tempest-TestShelveInstance-338113509-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-169677656" status: 202 len: 0 microversion: 2.1 time: 0.024247 Oct 01 04:28:48.462106 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 494/1019] 10.222.0.26 () {58 vars in 1251 bytes} [Sat Oct 1 04:28:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-169677656 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 04:29:09.040189 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1646678a-f4e7-4ac4-8008-d5341e594715 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:29:09.040710 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1646678a-f4e7-4ac4-8008-d5341e594715 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 67294823-eb18-482e-86fa-bf3371a5ee32] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:29:09.043003 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=10 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:09.043663 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=20 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:09.049816 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1646678a-f4e7-4ac4-8008-d5341e594715 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:09.050308 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1646678a-f4e7-4ac4-8008-d5341e594715 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:09.050777 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1646678a-f4e7-4ac4-8008-d5341e594715 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:09.051469 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1646678a-f4e7-4ac4-8008-d5341e594715 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:09.052118 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1646678a-f4e7-4ac4-8008-d5341e594715 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:09.052688 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1646678a-f4e7-4ac4-8008-d5341e594715 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:09.077949 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1646678a-f4e7-4ac4-8008-d5341e594715 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32/ips" status: 200 len: 149 microversion: 2.1 time: 0.041534 Oct 01 04:29:09.078516 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 526/1020] 10.222.0.26 () {58 vars in 1248 bytes} [Sat Oct 1 04:29:09 2022] GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:29:10.410005 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:10.410755 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:29:10.414801 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-50e2e7fe-10f9-4f24-994f-4289253cbc84 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05306544-b51d-4d9c-8cf1-e8250dc517ef"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:29:10.417143 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-50e2e7fe-10f9-4f24-994f-4289253cbc84 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 67294823-eb18-482e-86fa-bf3371a5ee32] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:29:10.424994 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50e2e7fe-10f9-4f24-994f-4289253cbc84 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:10.425490 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50e2e7fe-10f9-4f24-994f-4289253cbc84 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:10.425935 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50e2e7fe-10f9-4f24-994f-4289253cbc84 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:10.426637 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50e2e7fe-10f9-4f24-994f-4289253cbc84 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:10.427107 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50e2e7fe-10f9-4f24-994f-4289253cbc84 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:10.427543 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-50e2e7fe-10f9-4f24-994f-4289253cbc84 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:10.662046 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-50e2e7fe-10f9-4f24-994f-4289253cbc84 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "POST /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253309 Oct 01 04:29:10.662656 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 495/1021] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 1 04:29:10 2022] POST /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:29:17.260001 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1ee18b2d-16d9-4fcb-bb62-56390eb91946 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:29:17.260520 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1ee18b2d-16d9-4fcb-bb62-56390eb91946 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 67294823-eb18-482e-86fa-bf3371a5ee32] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:29:17.267191 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ee18b2d-16d9-4fcb-bb62-56390eb91946 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:17.267943 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ee18b2d-16d9-4fcb-bb62-56390eb91946 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:17.268383 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ee18b2d-16d9-4fcb-bb62-56390eb91946 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:17.269103 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ee18b2d-16d9-4fcb-bb62-56390eb91946 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:17.269565 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ee18b2d-16d9-4fcb-bb62-56390eb91946 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:17.269993 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1ee18b2d-16d9-4fcb-bb62-56390eb91946 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:17.353252 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-1ee18b2d-16d9-4fcb-bb62-56390eb91946 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lazy-loading 'services' on Instance uuid 67294823-eb18-482e-86fa-bf3371a5ee32 {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:29:17.425146 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1ee18b2d-16d9-4fcb-bb62-56390eb91946 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "DELETE /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32/os-volume_attachments/05306544-b51d-4d9c-8cf1-e8250dc517ef" status: 202 len: 0 microversion: 2.1 time: 0.168929 Oct 01 04:29:17.425727 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 527/1022] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 1 04:29:17 2022] DELETE /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32/os-volume_attachments/05306544-b51d-4d9c-8cf1-e8250dc517ef => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 04:29:17.435798 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6ab71f4b-7fcb-4498-9b42-0f3ec95e9958 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:29:17.438203 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6ab71f4b-7fcb-4498-9b42-0f3ec95e9958 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 67294823-eb18-482e-86fa-bf3371a5ee32] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:29:17.446187 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ab71f4b-7fcb-4498-9b42-0f3ec95e9958 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:17.446724 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ab71f4b-7fcb-4498-9b42-0f3ec95e9958 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:17.447355 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ab71f4b-7fcb-4498-9b42-0f3ec95e9958 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:17.448087 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ab71f4b-7fcb-4498-9b42-0f3ec95e9958 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:17.448534 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ab71f4b-7fcb-4498-9b42-0f3ec95e9958 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:17.449074 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6ab71f4b-7fcb-4498-9b42-0f3ec95e9958 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:17.482201 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6ab71f4b-7fcb-4498-9b42-0f3ec95e9958 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051389 Oct 01 04:29:17.482763 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 496/1023] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 1 04:29:17 2022] GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:29:18.495926 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d61d65d4-e49b-46dd-bc75-d2d74c213ad0 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:29:18.498770 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d61d65d4-e49b-46dd-bc75-d2d74c213ad0 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 67294823-eb18-482e-86fa-bf3371a5ee32] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:29:18.505102 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d61d65d4-e49b-46dd-bc75-d2d74c213ad0 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:18.505596 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d61d65d4-e49b-46dd-bc75-d2d74c213ad0 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:18.506033 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d61d65d4-e49b-46dd-bc75-d2d74c213ad0 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:18.506732 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d61d65d4-e49b-46dd-bc75-d2d74c213ad0 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:18.507190 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d61d65d4-e49b-46dd-bc75-d2d74c213ad0 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:18.507625 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d61d65d4-e49b-46dd-bc75-d2d74c213ad0 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:18.538163 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d61d65d4-e49b-46dd-bc75-d2d74c213ad0 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047002 Oct 01 04:29:18.538712 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 528/1024] 10.222.0.26 () {58 vars in 1302 bytes} [Sat Oct 1 04:29:18 2022] GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 01 04:29:18.601054 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-6e1c08d8-cfe9-4395-962c-1f09313271d7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:29:18.601596 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6e1c08d8-cfe9-4395-962c-1f09313271d7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 67294823-eb18-482e-86fa-bf3371a5ee32] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:29:18.608600 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e1c08d8-cfe9-4395-962c-1f09313271d7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:18.609056 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e1c08d8-cfe9-4395-962c-1f09313271d7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:18.609504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e1c08d8-cfe9-4395-962c-1f09313271d7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:18.610202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e1c08d8-cfe9-4395-962c-1f09313271d7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:18.610783 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e1c08d8-cfe9-4395-962c-1f09313271d7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:18.611218 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-6e1c08d8-cfe9-4395-962c-1f09313271d7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:18.637328 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-6e1c08d8-cfe9-4395-962c-1f09313271d7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 67294823-eb18-482e-86fa-bf3371a5ee32] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 04:29:18.710975 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-6e1c08d8-cfe9-4395-962c-1f09313271d7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "DELETE /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32" status: 204 len: 0 microversion: 2.1 time: 0.113599 Oct 01 04:29:18.712236 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 497/1025] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 1 04:29:18 2022] DELETE /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 04:29:18.720813 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-290e516e-ac77-47ad-84b2-a93fd833ac17 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:29:18.721467 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-290e516e-ac77-47ad-84b2-a93fd833ac17 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 67294823-eb18-482e-86fa-bf3371a5ee32] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:29:18.727312 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-290e516e-ac77-47ad-84b2-a93fd833ac17 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:18.727787 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-290e516e-ac77-47ad-84b2-a93fd833ac17 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:18.728215 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-290e516e-ac77-47ad-84b2-a93fd833ac17 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:18.728893 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-290e516e-ac77-47ad-84b2-a93fd833ac17 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:18.729396 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-290e516e-ac77-47ad-84b2-a93fd833ac17 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:18.729818 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-290e516e-ac77-47ad-84b2-a93fd833ac17 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:18.858559 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-290e516e-ac77-47ad-84b2-a93fd833ac17 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:29:18.866326 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-290e516e-ac77-47ad-84b2-a93fd833ac17 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32" status: 200 len: 1680 microversion: 2.1 time: 0.149271 Oct 01 04:29:18.866829 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 529/1026] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:29:18 2022] GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:29:19.890724 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-1128de5f-fc6d-48c9-8fc5-770a188d1613 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:29:19.891343 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-1128de5f-fc6d-48c9-8fc5-770a188d1613 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 67294823-eb18-482e-86fa-bf3371a5ee32] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:29:19.898140 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1128de5f-fc6d-48c9-8fc5-770a188d1613 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:19.898635 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1128de5f-fc6d-48c9-8fc5-770a188d1613 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:19.899078 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1128de5f-fc6d-48c9-8fc5-770a188d1613 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:19.899781 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1128de5f-fc6d-48c9-8fc5-770a188d1613 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:19.900245 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1128de5f-fc6d-48c9-8fc5-770a188d1613 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:19.900672 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-1128de5f-fc6d-48c9-8fc5-770a188d1613 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:20.034515 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-1128de5f-fc6d-48c9-8fc5-770a188d1613 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:29:20.042230 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-1128de5f-fc6d-48c9-8fc5-770a188d1613 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32" status: 200 len: 1680 microversion: 2.1 time: 0.156416 Oct 01 04:29:20.042796 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 498/1027] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:29:19 2022] GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:29:21.066706 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-013a133b-e045-43bf-a08e-aa4f3be45be7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:29:21.067324 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-013a133b-e045-43bf-a08e-aa4f3be45be7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 67294823-eb18-482e-86fa-bf3371a5ee32] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:29:21.075552 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-013a133b-e045-43bf-a08e-aa4f3be45be7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:21.076054 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-013a133b-e045-43bf-a08e-aa4f3be45be7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:21.076565 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-013a133b-e045-43bf-a08e-aa4f3be45be7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:21.077321 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-013a133b-e045-43bf-a08e-aa4f3be45be7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:21.077780 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-013a133b-e045-43bf-a08e-aa4f3be45be7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:21.078203 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-013a133b-e045-43bf-a08e-aa4f3be45be7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:21.144740 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-013a133b-e045-43bf-a08e-aa4f3be45be7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0e30d69a25494d70bc094eb92c4f9bb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57f927e7829a4172b9919b964a9e7c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:29:21.153892 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-013a133b-e045-43bf-a08e-aa4f3be45be7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32" status: 200 len: 1613 microversion: 2.1 time: 0.090316 Oct 01 04:29:21.154479 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 530/1028] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:29:21 2022] GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32 => generated 1613 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:29:21.293376 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-414ebbaf-6097-4c11-98b1-12b688fcdbcc req-f46d108a-5e49-4b80-8ac6-efecef2e9723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67294823-eb18-482e-86fa-bf3371a5ee32", "name": "network-vif-deleted", "tag": "b26672bb-dbc8-4e52-a5fb-c61d98b762c2"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:29:21.304017 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-414ebbaf-6097-4c11-98b1-12b688fcdbcc req-f46d108a-5e49-4b80-8ac6-efecef2e9723 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:21.304565 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-414ebbaf-6097-4c11-98b1-12b688fcdbcc req-f46d108a-5e49-4b80-8ac6-efecef2e9723 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:21.305309 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-414ebbaf-6097-4c11-98b1-12b688fcdbcc req-f46d108a-5e49-4b80-8ac6-efecef2e9723 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:21.319033 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-414ebbaf-6097-4c11-98b1-12b688fcdbcc req-f46d108a-5e49-4b80-8ac6-efecef2e9723 service nova] Creating event network-vif-deleted:b26672bb-dbc8-4e52-a5fb-c61d98b762c2 for instance 67294823-eb18-482e-86fa-bf3371a5ee32 on hv-cinder-86004 Oct 01 04:29:21.324185 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-414ebbaf-6097-4c11-98b1-12b688fcdbcc req-f46d108a-5e49-4b80-8ac6-efecef2e9723 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034519 Oct 01 04:29:21.325602 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 499/1029] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:29:22.178022 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-712adf5e-947d-4e66-a767-294f9b9a67a2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:29:22.178762 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-712adf5e-947d-4e66-a767-294f9b9a67a2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 67294823-eb18-482e-86fa-bf3371a5ee32] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:29:22.185884 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-712adf5e-947d-4e66-a767-294f9b9a67a2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:22.186370 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-712adf5e-947d-4e66-a767-294f9b9a67a2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:22.186802 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-712adf5e-947d-4e66-a767-294f9b9a67a2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:22.187499 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-712adf5e-947d-4e66-a767-294f9b9a67a2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:22.188122 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-712adf5e-947d-4e66-a767-294f9b9a67a2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:22.188497 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-712adf5e-947d-4e66-a767-294f9b9a67a2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:22.204286 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-712adf5e-947d-4e66-a767-294f9b9a67a2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] HTTP exception thrown: Instance 67294823-eb18-482e-86fa-bf3371a5ee32 could not be found. Oct 01 04:29:22.205986 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-712adf5e-947d-4e66-a767-294f9b9a67a2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Request method failure captured: Oct 01 04:29:22.205986 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32 HTTP/1.1 Oct 01 04:29:22.205986 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:29:22.205986 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:29:22.205986 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:29:22.205986 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 0 Oct 01 04:29:22.205986 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:29:22.205986 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:29:22.205986 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:29:22.205986 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:29:22.205986 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN8EwZiIdaSHgJefVWHSlZ0UU8OX8R0aPtB8r1Pr3nfRFZLn6johVmlyimBuO6m2htmIzgGcwibHj5pfyrNspEC0yv0MbvK2BKJDTuaMjl6PU4M8pcs1czjr2NKHPBvNTiXqfyyojseF__WWl_lh7hlPx5Xw0WdfDj8zF_1x1MH7EsUY Oct 01 04:29:22.205986 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:29:22.205986 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:29:22.205986 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:29:22.205986 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:29:22.205986 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:29:22.205986 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:29:22.205986 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: 57f927e7829a4172b9919b964a9e7c13 Oct 01 04:29:22.205986 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:29:22.205986 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:29:22.205986 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:29:22.207612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:29:22.207612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:29:22.207612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 57f927e7829a4172b9919b964a9e7c13 Oct 01 04:29:22.207612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:29:22.207612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-AttachVolumeNegativeTest-41085015-project Oct 01 04:29:22.207612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:29:22.207612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:29:22.207612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: 0e30d69a25494d70bc094eb92c4f9bb0 Oct 01 04:29:22.207612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeNegativeTest-41085015-project Oct 01 04:29:22.207612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: > Oct 01 04:29:22.207612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Instance 67294823-eb18-482e-86fa-bf3371a5ee32 could not be found. Oct 01 04:29:22.207612 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'id': '67294823-eb18-482e-86fa-bf3371a5ee32'} Oct 01 04:29:22.208412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:29:22.208412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:29:22.208412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:29:22.208412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:29:22.208412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:29:22.208412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:29:22.208412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:29:22.208412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:29:22.208412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:29:22.208412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:29:22.208412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67294823-eb18-482e-86fa-bf3371a5ee32 could not be found. Oct 01 04:29:22.208412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:29:22.208412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:29:22.208412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:29:22.208412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:29:22.208412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:29:22.208412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:29:22.208412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:29:22.208412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:29:22.208412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:29:22.209831 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:29:22.209831 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:29:22.209831 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:29:22.209831 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:29:22.209831 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:29:22.209831 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:29:22.209831 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:29:22.209831 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67294823-eb18-482e-86fa-bf3371a5ee32 could not be found. Oct 01 04:29:22.209831 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:29:22.209831 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:29:22.209831 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:29:22.209831 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:29:22.209831 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:29:22.209831 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:29:22.209831 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:29:22.209831 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:29:22.209831 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67294823-eb18-482e-86fa-bf3371a5ee32 could not be found. Oct 01 04:29:22.209831 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:29:22.211027 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-712adf5e-947d-4e66-a767-294f9b9a67a2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Returning 404 to user: Instance 67294823-eb18-482e-86fa-bf3371a5ee32 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:29:22.211027 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-712adf5e-947d-4e66-a767-294f9b9a67a2 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32" status: 404 len: 111 microversion: 2.1 time: 0.033465 Oct 01 04:29:22.211027 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 531/1030] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:29:22 2022] GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:29:22.217539 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-e27e60d6-9948-4655-b5f6-181980b341e9 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '.version_select at 0x7fdfbe8eda60>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:29:22.237287 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-e27e60d6-9948-4655-b5f6-181980b341e9 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1119198569" status: 202 len: 0 microversion: 2.1 time: 0.024555 Oct 01 04:29:22.237860 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 500/1031] 10.222.0.26 () {58 vars in 1221 bytes} [Sat Oct 1 04:29:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1119198569 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 04:29:23.987903 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b6fb57ab-2d4b-469c-b2b7-e564139218f4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:29:23.988420 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-b6fb57ab-2d4b-469c-b2b7-e564139218f4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 67294823-eb18-482e-86fa-bf3371a5ee32] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:29:23.994751 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6fb57ab-2d4b-469c-b2b7-e564139218f4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:23.995237 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6fb57ab-2d4b-469c-b2b7-e564139218f4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:23.995679 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6fb57ab-2d4b-469c-b2b7-e564139218f4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:23.996369 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6fb57ab-2d4b-469c-b2b7-e564139218f4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:23.996854 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6fb57ab-2d4b-469c-b2b7-e564139218f4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:23.997314 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-b6fb57ab-2d4b-469c-b2b7-e564139218f4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:24.010536 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-b6fb57ab-2d4b-469c-b2b7-e564139218f4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] HTTP exception thrown: Instance 67294823-eb18-482e-86fa-bf3371a5ee32 could not be found. Oct 01 04:29:24.012063 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b6fb57ab-2d4b-469c-b2b7-e564139218f4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Request method failure captured: Oct 01 04:29:24.012063 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32 HTTP/1.1 Oct 01 04:29:24.012063 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:29:24.012063 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:29:24.012063 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:29:24.012063 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 0 Oct 01 04:29:24.012063 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:29:24.012063 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:29:24.012063 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:29:24.012063 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:29:24.012063 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN8EwZiIdaSHgJefVWHSlZ0UU8OX8R0aPtB8r1Pr3nfRFZLn6johVmlyimBuO6m2htmIzgGcwibHj5pfyrNspEC0yv0MbvK2BKJDTuaMjl6PU4M8pcs1czjr2NKHPBvNTiXqfyyojseF__WWl_lh7hlPx5Xw0WdfDj8zF_1x1MH7EsUY Oct 01 04:29:24.012063 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:29:24.012063 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:29:24.012063 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:29:24.012063 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:29:24.012063 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:29:24.012063 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:29:24.012063 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: 57f927e7829a4172b9919b964a9e7c13 Oct 01 04:29:24.012063 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:29:24.012063 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:29:24.012063 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:29:24.013841 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:29:24.013841 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:29:24.013841 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 57f927e7829a4172b9919b964a9e7c13 Oct 01 04:29:24.013841 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:29:24.013841 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-AttachVolumeNegativeTest-41085015-project Oct 01 04:29:24.013841 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:29:24.013841 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:29:24.013841 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: 0e30d69a25494d70bc094eb92c4f9bb0 Oct 01 04:29:24.013841 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeNegativeTest-41085015-project Oct 01 04:29:24.013841 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: > Oct 01 04:29:24.013841 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Instance 67294823-eb18-482e-86fa-bf3371a5ee32 could not be found. Oct 01 04:29:24.013841 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'id': '67294823-eb18-482e-86fa-bf3371a5ee32'} Oct 01 04:29:24.014991 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:29:24.014991 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:29:24.014991 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:29:24.014991 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:29:24.014991 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:29:24.014991 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:29:24.014991 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:29:24.014991 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:29:24.014991 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:29:24.014991 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:29:24.014991 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67294823-eb18-482e-86fa-bf3371a5ee32 could not be found. Oct 01 04:29:24.014991 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:29:24.014991 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:29:24.014991 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:29:24.014991 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:29:24.014991 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:29:24.014991 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:29:24.014991 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:29:24.014991 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:29:24.014991 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:29:24.017187 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:29:24.017187 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 04:29:24.017187 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 04:29:24.017187 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 04:29:24.017187 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 04:29:24.017187 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:29:24.017187 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:29:24.017187 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:29:24.017187 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:29:24.017187 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67294823-eb18-482e-86fa-bf3371a5ee32 could not be found. Oct 01 04:29:24.017187 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:29:24.017187 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:29:24.017187 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:29:24.017187 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:29:24.017187 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:29:24.017187 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:29:24.017187 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:29:24.017187 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:29:24.017187 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67294823-eb18-482e-86fa-bf3371a5ee32 could not be found. Oct 01 04:29:24.017187 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:29:24.019423 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-b6fb57ab-2d4b-469c-b2b7-e564139218f4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Returning 404 to user: Instance 67294823-eb18-482e-86fa-bf3371a5ee32 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:29:24.019423 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-b6fb57ab-2d4b-469c-b2b7-e564139218f4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "DELETE /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32" status: 404 len: 111 microversion: 2.1 time: 0.029408 Oct 01 04:29:24.019423 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 532/1032] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 1 04:29:23 2022] DELETE /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:29:24.025911 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4050b257-7c0c-48a1-a0ab-e9b667a7b02a tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:29:24.026654 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4050b257-7c0c-48a1-a0ab-e9b667a7b02a tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 67294823-eb18-482e-86fa-bf3371a5ee32] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:29:24.034227 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4050b257-7c0c-48a1-a0ab-e9b667a7b02a tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:24.034708 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4050b257-7c0c-48a1-a0ab-e9b667a7b02a tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:24.035140 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4050b257-7c0c-48a1-a0ab-e9b667a7b02a tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:24.035824 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4050b257-7c0c-48a1-a0ab-e9b667a7b02a tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:24.036279 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4050b257-7c0c-48a1-a0ab-e9b667a7b02a tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:24.036701 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4050b257-7c0c-48a1-a0ab-e9b667a7b02a tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:24.050218 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-4050b257-7c0c-48a1-a0ab-e9b667a7b02a tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] HTTP exception thrown: Instance 67294823-eb18-482e-86fa-bf3371a5ee32 could not be found. Oct 01 04:29:24.051834 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4050b257-7c0c-48a1-a0ab-e9b667a7b02a tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Request method failure captured: Oct 01 04:29:24.051834 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32 HTTP/1.1 Oct 01 04:29:24.051834 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept: application/json Oct 01 04:29:24.051834 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept-Encoding: identity Oct 01 04:29:24.051834 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Connection: close Oct 01 04:29:24.051834 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Length: 0 Oct 01 04:29:24.051834 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Type: application/json Oct 01 04:29:24.051834 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Host: 10.222.0.26 Oct 01 04:29:24.051834 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 01 04:29:24.051834 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 01 04:29:24.051834 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjN8EwZiIdaSHgJefVWHSlZ0UU8OX8R0aPtB8r1Pr3nfRFZLn6johVmlyimBuO6m2htmIzgGcwibHj5pfyrNspEC0yv0MbvK2BKJDTuaMjl6PU4M8pcs1czjr2NKHPBvNTiXqfyyojseF__WWl_lh7hlPx5Xw0WdfDj8zF_1x1MH7EsUY Oct 01 04:29:24.051834 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Id: None Oct 01 04:29:24.051834 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Name: None Oct 01 04:29:24.051834 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 01 04:29:24.051834 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 01 04:29:24.051834 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 01 04:29:24.051834 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 01 04:29:24.051834 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Id: 57f927e7829a4172b9919b964a9e7c13 Oct 01 04:29:24.051834 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Name: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:29:24.051834 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Role: reader,member Oct 01 04:29:24.051834 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Roles: reader,member Oct 01 04:29:24.053527 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:29:24.053527 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:29:24.053527 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Id: 57f927e7829a4172b9919b964a9e7c13 Oct 01 04:29:24.053527 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:29:24.053527 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User: tempest-AttachVolumeNegativeTest-41085015-project Oct 01 04:29:24.053527 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 01 04:29:24.053527 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 01 04:29:24.053527 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Id: 0e30d69a25494d70bc094eb92c4f9bb0 Oct 01 04:29:24.053527 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Name: tempest-AttachVolumeNegativeTest-41085015-project Oct 01 04:29:24.053527 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: method: > Oct 01 04:29:24.053527 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: exception: Instance 67294823-eb18-482e-86fa-bf3371a5ee32 could not be found. Oct 01 04:29:24.053527 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: action_args: {'id': '67294823-eb18-482e-86fa-bf3371a5ee32'} Oct 01 04:29:24.054465 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:29:24.054465 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:29:24.054465 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:29:24.054465 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:29:24.054465 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:29:24.054465 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:29:24.054465 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:29:24.054465 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:29:24.054465 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:29:24.054465 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:29:24.054465 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67294823-eb18-482e-86fa-bf3371a5ee32 could not be found. Oct 01 04:29:24.054465 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:29:24.054465 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:29:24.054465 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:29:24.054465 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:29:24.054465 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:29:24.054465 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:29:24.054465 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:29:24.054465 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:29:24.054465 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:29:24.056136 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:29:24.056136 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:29:24.056136 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:29:24.056136 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:29:24.056136 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:29:24.056136 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:29:24.056136 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:29:24.056136 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67294823-eb18-482e-86fa-bf3371a5ee32 could not be found. Oct 01 04:29:24.056136 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:29:24.056136 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:29:24.056136 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:29:24.056136 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:29:24.056136 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:29:24.056136 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:29:24.056136 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:29:24.056136 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:29:24.056136 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67294823-eb18-482e-86fa-bf3371a5ee32 could not be found. Oct 01 04:29:24.056136 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:29:24.057836 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4050b257-7c0c-48a1-a0ab-e9b667a7b02a tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Returning 404 to user: Instance 67294823-eb18-482e-86fa-bf3371a5ee32 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:29:24.057836 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4050b257-7c0c-48a1-a0ab-e9b667a7b02a tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32" status: 404 len: 111 microversion: 2.1 time: 0.031967 Oct 01 04:29:24.057836 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 501/1033] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:29:24 2022] GET /compute/v2.1/servers/67294823-eb18-482e-86fa-bf3371a5ee32 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 01 04:29:25.195939 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e7b4bcf6-6fdd-43c9-89d3-1098ca74424d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:29:25.196462 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e7b4bcf6-6fdd-43c9-89d3-1098ca74424d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 132e0a82-5272-4ff5-a141-33f0cb0944a1] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:29:25.203518 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7b4bcf6-6fdd-43c9-89d3-1098ca74424d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:25.203997 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7b4bcf6-6fdd-43c9-89d3-1098ca74424d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:25.204430 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7b4bcf6-6fdd-43c9-89d3-1098ca74424d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:25.205149 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7b4bcf6-6fdd-43c9-89d3-1098ca74424d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:25.205606 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7b4bcf6-6fdd-43c9-89d3-1098ca74424d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:25.206028 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e7b4bcf6-6fdd-43c9-89d3-1098ca74424d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:25.219258 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-e7b4bcf6-6fdd-43c9-89d3-1098ca74424d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] HTTP exception thrown: Instance 132e0a82-5272-4ff5-a141-33f0cb0944a1 could not be found. Oct 01 04:29:25.220796 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e7b4bcf6-6fdd-43c9-89d3-1098ca74424d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Request method failure captured: Oct 01 04:29:25.220796 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1 HTTP/1.1 Oct 01 04:29:25.220796 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:29:25.220796 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:29:25.220796 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:29:25.220796 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 0 Oct 01 04:29:25.220796 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:29:25.220796 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:29:25.220796 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:29:25.220796 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:29:25.220796 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN8EwZiIdaSHgJefVWHSlZ0UU8OX8R0aPtB8r1Pr3nfRFZLn6johVmlyimBuO6m2htmIzgGcwibHj5pfyrNspEC0yv0MbvK2BKJDTuaMjl6PU4M8pcs1czjr2NKHPBvNTiXqfyyojseF__WWl_lh7hlPx5Xw0WdfDj8zF_1x1MH7EsUY Oct 01 04:29:25.220796 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:29:25.220796 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:29:25.220796 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:29:25.220796 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:29:25.220796 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:29:25.220796 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:29:25.220796 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: 57f927e7829a4172b9919b964a9e7c13 Oct 01 04:29:25.220796 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:29:25.220796 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:29:25.220796 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:29:25.222407 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:29:25.222407 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:29:25.222407 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 57f927e7829a4172b9919b964a9e7c13 Oct 01 04:29:25.222407 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:29:25.222407 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-AttachVolumeNegativeTest-41085015-project Oct 01 04:29:25.222407 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:29:25.222407 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:29:25.222407 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: 0e30d69a25494d70bc094eb92c4f9bb0 Oct 01 04:29:25.222407 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeNegativeTest-41085015-project Oct 01 04:29:25.222407 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: > Oct 01 04:29:25.222407 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Instance 132e0a82-5272-4ff5-a141-33f0cb0944a1 could not be found. Oct 01 04:29:25.222407 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'id': '132e0a82-5272-4ff5-a141-33f0cb0944a1'} Oct 01 04:29:25.223481 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:29:25.223481 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:29:25.223481 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:29:25.223481 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:29:25.223481 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:29:25.223481 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:29:25.223481 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:29:25.223481 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:29:25.223481 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:29:25.223481 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:29:25.223481 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 132e0a82-5272-4ff5-a141-33f0cb0944a1 could not be found. Oct 01 04:29:25.223481 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:29:25.223481 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:29:25.223481 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:29:25.223481 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:29:25.223481 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:29:25.223481 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:29:25.223481 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:29:25.223481 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:29:25.223481 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:29:25.224996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:29:25.224996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 04:29:25.224996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 04:29:25.224996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 04:29:25.224996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 04:29:25.224996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:29:25.224996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:29:25.224996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:29:25.224996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:29:25.224996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 132e0a82-5272-4ff5-a141-33f0cb0944a1 could not be found. Oct 01 04:29:25.224996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:29:25.224996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:29:25.224996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:29:25.224996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:29:25.224996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:29:25.224996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:29:25.224996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:29:25.224996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:29:25.224996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 132e0a82-5272-4ff5-a141-33f0cb0944a1 could not be found. Oct 01 04:29:25.224996 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:29:25.226574 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e7b4bcf6-6fdd-43c9-89d3-1098ca74424d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Returning 404 to user: Instance 132e0a82-5272-4ff5-a141-33f0cb0944a1 could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:29:25.226574 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e7b4bcf6-6fdd-43c9-89d3-1098ca74424d tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "DELETE /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1" status: 404 len: 111 microversion: 2.1 time: 0.030073 Oct 01 04:29:25.226574 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 533/1034] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 1 04:29:25 2022] DELETE /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:29:25.230575 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4bf05518-f889-48df-8b2b-7d1f3c107701 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:29:25.231260 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4bf05518-f889-48df-8b2b-7d1f3c107701 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 132e0a82-5272-4ff5-a141-33f0cb0944a1] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:29:25.237667 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bf05518-f889-48df-8b2b-7d1f3c107701 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:25.238154 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bf05518-f889-48df-8b2b-7d1f3c107701 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:25.238591 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bf05518-f889-48df-8b2b-7d1f3c107701 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:25.239320 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bf05518-f889-48df-8b2b-7d1f3c107701 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:25.239785 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bf05518-f889-48df-8b2b-7d1f3c107701 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:25.240211 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4bf05518-f889-48df-8b2b-7d1f3c107701 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:25.256340 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-4bf05518-f889-48df-8b2b-7d1f3c107701 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] HTTP exception thrown: Instance 132e0a82-5272-4ff5-a141-33f0cb0944a1 could not be found. Oct 01 04:29:25.259202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4bf05518-f889-48df-8b2b-7d1f3c107701 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Request method failure captured: Oct 01 04:29:25.259202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1 HTTP/1.1 Oct 01 04:29:25.259202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept: application/json Oct 01 04:29:25.259202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept-Encoding: identity Oct 01 04:29:25.259202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Connection: close Oct 01 04:29:25.259202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Length: 0 Oct 01 04:29:25.259202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Type: application/json Oct 01 04:29:25.259202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Host: 10.222.0.26 Oct 01 04:29:25.259202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 01 04:29:25.259202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 01 04:29:25.259202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjN8EwZiIdaSHgJefVWHSlZ0UU8OX8R0aPtB8r1Pr3nfRFZLn6johVmlyimBuO6m2htmIzgGcwibHj5pfyrNspEC0yv0MbvK2BKJDTuaMjl6PU4M8pcs1czjr2NKHPBvNTiXqfyyojseF__WWl_lh7hlPx5Xw0WdfDj8zF_1x1MH7EsUY Oct 01 04:29:25.259202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Id: None Oct 01 04:29:25.259202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Name: None Oct 01 04:29:25.259202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 01 04:29:25.259202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 01 04:29:25.259202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 01 04:29:25.259202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 01 04:29:25.259202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Id: 57f927e7829a4172b9919b964a9e7c13 Oct 01 04:29:25.259202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Name: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:29:25.259202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Role: reader,member Oct 01 04:29:25.259202 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Roles: reader,member Oct 01 04:29:25.260861 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:29:25.260861 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:29:25.260861 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Id: 57f927e7829a4172b9919b964a9e7c13 Oct 01 04:29:25.260861 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:29:25.260861 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User: tempest-AttachVolumeNegativeTest-41085015-project Oct 01 04:29:25.260861 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 01 04:29:25.260861 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 01 04:29:25.260861 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Id: 0e30d69a25494d70bc094eb92c4f9bb0 Oct 01 04:29:25.260861 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Name: tempest-AttachVolumeNegativeTest-41085015-project Oct 01 04:29:25.260861 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: method: > Oct 01 04:29:25.260861 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: exception: Instance 132e0a82-5272-4ff5-a141-33f0cb0944a1 could not be found. Oct 01 04:29:25.260861 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: action_args: {'id': '132e0a82-5272-4ff5-a141-33f0cb0944a1'} Oct 01 04:29:25.261719 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:29:25.261719 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:29:25.261719 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:29:25.261719 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:29:25.261719 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:29:25.261719 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:29:25.261719 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:29:25.261719 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:29:25.261719 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:29:25.261719 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:29:25.261719 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 132e0a82-5272-4ff5-a141-33f0cb0944a1 could not be found. Oct 01 04:29:25.261719 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:29:25.261719 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:29:25.261719 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:29:25.261719 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:29:25.261719 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:29:25.261719 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:29:25.261719 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:29:25.261719 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:29:25.261719 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:29:25.263607 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:29:25.263607 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:29:25.263607 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:29:25.263607 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:29:25.263607 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:29:25.263607 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:29:25.263607 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:29:25.263607 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 132e0a82-5272-4ff5-a141-33f0cb0944a1 could not be found. Oct 01 04:29:25.263607 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:29:25.263607 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:29:25.263607 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:29:25.263607 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:29:25.263607 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:29:25.263607 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:29:25.263607 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:29:25.263607 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:29:25.263607 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 132e0a82-5272-4ff5-a141-33f0cb0944a1 could not be found. Oct 01 04:29:25.263607 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:29:25.264730 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4bf05518-f889-48df-8b2b-7d1f3c107701 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Returning 404 to user: Instance 132e0a82-5272-4ff5-a141-33f0cb0944a1 could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:29:25.264730 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4bf05518-f889-48df-8b2b-7d1f3c107701 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1" status: 404 len: 111 microversion: 2.1 time: 0.033945 Oct 01 04:29:25.264730 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 502/1035] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:29:25 2022] GET /compute/v2.1/servers/132e0a82-5272-4ff5-a141-33f0cb0944a1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:29:25.269970 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e41ef67f-abf2-425e-af80-46e8f88b9deb tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:29:25.270462 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e41ef67f-abf2-425e-af80-46e8f88b9deb tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 9c97834c-96c0-475f-90e5-f51da938482a] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:29:25.276359 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e41ef67f-abf2-425e-af80-46e8f88b9deb tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:25.276834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e41ef67f-abf2-425e-af80-46e8f88b9deb tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:25.277308 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e41ef67f-abf2-425e-af80-46e8f88b9deb tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:25.278007 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e41ef67f-abf2-425e-af80-46e8f88b9deb tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:25.278447 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e41ef67f-abf2-425e-af80-46e8f88b9deb tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:25.278866 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e41ef67f-abf2-425e-af80-46e8f88b9deb tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:25.291918 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-e41ef67f-abf2-425e-af80-46e8f88b9deb tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] HTTP exception thrown: Instance 9c97834c-96c0-475f-90e5-f51da938482a could not be found. Oct 01 04:29:25.293475 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e41ef67f-abf2-425e-af80-46e8f88b9deb tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Request method failure captured: Oct 01 04:29:25.293475 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a HTTP/1.1 Oct 01 04:29:25.293475 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:29:25.293475 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:29:25.293475 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:29:25.293475 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 0 Oct 01 04:29:25.293475 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:29:25.293475 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:29:25.293475 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:29:25.293475 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:29:25.293475 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN8EwZiIdaSHgJefVWHSlZ0UU8OX8R0aPtB8r1Pr3nfRFZLn6johVmlyimBuO6m2htmIzgGcwibHj5pfyrNspEC0yv0MbvK2BKJDTuaMjl6PU4M8pcs1czjr2NKHPBvNTiXqfyyojseF__WWl_lh7hlPx5Xw0WdfDj8zF_1x1MH7EsUY Oct 01 04:29:25.293475 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:29:25.293475 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:29:25.293475 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:29:25.293475 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:29:25.293475 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:29:25.293475 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:29:25.293475 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: 57f927e7829a4172b9919b964a9e7c13 Oct 01 04:29:25.293475 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:29:25.293475 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:29:25.293475 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:29:25.295313 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:29:25.295313 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:29:25.295313 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 57f927e7829a4172b9919b964a9e7c13 Oct 01 04:29:25.295313 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:29:25.295313 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-AttachVolumeNegativeTest-41085015-project Oct 01 04:29:25.295313 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:29:25.295313 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:29:25.295313 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: 0e30d69a25494d70bc094eb92c4f9bb0 Oct 01 04:29:25.295313 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeNegativeTest-41085015-project Oct 01 04:29:25.295313 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: > Oct 01 04:29:25.295313 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Instance 9c97834c-96c0-475f-90e5-f51da938482a could not be found. Oct 01 04:29:25.295313 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'id': '9c97834c-96c0-475f-90e5-f51da938482a'} Oct 01 04:29:25.296171 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:29:25.296171 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:29:25.296171 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:29:25.296171 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:29:25.296171 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:29:25.296171 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:29:25.296171 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:29:25.296171 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:29:25.296171 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:29:25.296171 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:29:25.296171 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c97834c-96c0-475f-90e5-f51da938482a could not be found. Oct 01 04:29:25.296171 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:29:25.296171 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:29:25.296171 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:29:25.296171 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:29:25.296171 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:29:25.296171 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:29:25.296171 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:29:25.296171 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:29:25.296171 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:29:25.297742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:29:25.297742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 04:29:25.297742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 04:29:25.297742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 04:29:25.297742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 04:29:25.297742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:29:25.297742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:29:25.297742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:29:25.297742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:29:25.297742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c97834c-96c0-475f-90e5-f51da938482a could not be found. Oct 01 04:29:25.297742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:29:25.297742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:29:25.297742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:29:25.297742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:29:25.297742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:29:25.297742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:29:25.297742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:29:25.297742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:29:25.297742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c97834c-96c0-475f-90e5-f51da938482a could not be found. Oct 01 04:29:25.297742 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:29:25.299551 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e41ef67f-abf2-425e-af80-46e8f88b9deb tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Returning 404 to user: Instance 9c97834c-96c0-475f-90e5-f51da938482a could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:29:25.299551 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e41ef67f-abf2-425e-af80-46e8f88b9deb tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a" status: 404 len: 111 microversion: 2.1 time: 0.029123 Oct 01 04:29:25.299551 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 534/1036] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 1 04:29:25 2022] DELETE /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:29:25.303214 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-917c0e4f-250a-4288-9cd5-d6257d8eada4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:29:25.303864 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-917c0e4f-250a-4288-9cd5-d6257d8eada4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 9c97834c-96c0-475f-90e5-f51da938482a] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:29:25.310398 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-917c0e4f-250a-4288-9cd5-d6257d8eada4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:25.310887 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-917c0e4f-250a-4288-9cd5-d6257d8eada4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:25.311335 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-917c0e4f-250a-4288-9cd5-d6257d8eada4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:25.312032 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-917c0e4f-250a-4288-9cd5-d6257d8eada4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:25.312499 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-917c0e4f-250a-4288-9cd5-d6257d8eada4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:25.312952 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-917c0e4f-250a-4288-9cd5-d6257d8eada4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:25.326576 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-917c0e4f-250a-4288-9cd5-d6257d8eada4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] HTTP exception thrown: Instance 9c97834c-96c0-475f-90e5-f51da938482a could not be found. Oct 01 04:29:25.328150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-917c0e4f-250a-4288-9cd5-d6257d8eada4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Request method failure captured: Oct 01 04:29:25.328150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a HTTP/1.1 Oct 01 04:29:25.328150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept: application/json Oct 01 04:29:25.328150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept-Encoding: identity Oct 01 04:29:25.328150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Connection: close Oct 01 04:29:25.328150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Length: 0 Oct 01 04:29:25.328150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Type: application/json Oct 01 04:29:25.328150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Host: 10.222.0.26 Oct 01 04:29:25.328150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 01 04:29:25.328150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 01 04:29:25.328150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjN8EwZiIdaSHgJefVWHSlZ0UU8OX8R0aPtB8r1Pr3nfRFZLn6johVmlyimBuO6m2htmIzgGcwibHj5pfyrNspEC0yv0MbvK2BKJDTuaMjl6PU4M8pcs1czjr2NKHPBvNTiXqfyyojseF__WWl_lh7hlPx5Xw0WdfDj8zF_1x1MH7EsUY Oct 01 04:29:25.328150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Id: None Oct 01 04:29:25.328150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Name: None Oct 01 04:29:25.328150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 01 04:29:25.328150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 01 04:29:25.328150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 01 04:29:25.328150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 01 04:29:25.328150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Id: 57f927e7829a4172b9919b964a9e7c13 Oct 01 04:29:25.328150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Name: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:29:25.328150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Role: reader,member Oct 01 04:29:25.328150 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Roles: reader,member Oct 01 04:29:25.329944 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:29:25.329944 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:29:25.329944 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Id: 57f927e7829a4172b9919b964a9e7c13 Oct 01 04:29:25.329944 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:29:25.329944 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User: tempest-AttachVolumeNegativeTest-41085015-project Oct 01 04:29:25.329944 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 01 04:29:25.329944 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 01 04:29:25.329944 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Id: 0e30d69a25494d70bc094eb92c4f9bb0 Oct 01 04:29:25.329944 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Name: tempest-AttachVolumeNegativeTest-41085015-project Oct 01 04:29:25.329944 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: method: > Oct 01 04:29:25.329944 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: exception: Instance 9c97834c-96c0-475f-90e5-f51da938482a could not be found. Oct 01 04:29:25.329944 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: action_args: {'id': '9c97834c-96c0-475f-90e5-f51da938482a'} Oct 01 04:29:25.331004 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:29:25.331004 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:29:25.331004 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:29:25.331004 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:29:25.331004 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:29:25.331004 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:29:25.331004 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:29:25.331004 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:29:25.331004 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:29:25.331004 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:29:25.331004 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c97834c-96c0-475f-90e5-f51da938482a could not be found. Oct 01 04:29:25.331004 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:29:25.331004 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:29:25.331004 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:29:25.331004 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:29:25.331004 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:29:25.331004 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:29:25.331004 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:29:25.331004 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:29:25.331004 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:29:25.332484 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:29:25.332484 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:29:25.332484 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:29:25.332484 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:29:25.332484 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:29:25.332484 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:29:25.332484 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:29:25.332484 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c97834c-96c0-475f-90e5-f51da938482a could not be found. Oct 01 04:29:25.332484 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:29:25.332484 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:29:25.332484 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:29:25.332484 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:29:25.332484 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:29:25.332484 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:29:25.332484 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:29:25.332484 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:29:25.332484 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c97834c-96c0-475f-90e5-f51da938482a could not be found. Oct 01 04:29:25.332484 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:29:25.333964 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-917c0e4f-250a-4288-9cd5-d6257d8eada4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Returning 404 to user: Instance 9c97834c-96c0-475f-90e5-f51da938482a could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:29:25.333964 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-917c0e4f-250a-4288-9cd5-d6257d8eada4 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a" status: 404 len: 111 microversion: 2.1 time: 0.030153 Oct 01 04:29:25.333964 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 503/1037] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:29:25 2022] GET /compute/v2.1/servers/9c97834c-96c0-475f-90e5-f51da938482a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:29:26.466516 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e16e7add-2cb6-4971-8b7b-3f899f30730f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:29:26.467022 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-e16e7add-2cb6-4971-8b7b-3f899f30730f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 7666cbd6-6648-4f0b-ba58-7a95bd94700c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:29:26.473428 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e16e7add-2cb6-4971-8b7b-3f899f30730f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:26.473910 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e16e7add-2cb6-4971-8b7b-3f899f30730f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:26.474352 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e16e7add-2cb6-4971-8b7b-3f899f30730f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:26.475057 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e16e7add-2cb6-4971-8b7b-3f899f30730f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:26.475516 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e16e7add-2cb6-4971-8b7b-3f899f30730f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:26.475940 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-e16e7add-2cb6-4971-8b7b-3f899f30730f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:26.490207 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-e16e7add-2cb6-4971-8b7b-3f899f30730f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] HTTP exception thrown: Instance 7666cbd6-6648-4f0b-ba58-7a95bd94700c could not be found. Oct 01 04:29:26.491730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e16e7add-2cb6-4971-8b7b-3f899f30730f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Request method failure captured: Oct 01 04:29:26.491730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: DELETE /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c HTTP/1.1 Oct 01 04:29:26.491730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:29:26.491730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:29:26.491730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:29:26.491730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 0 Oct 01 04:29:26.491730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:29:26.491730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:29:26.491730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:29:26.491730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:29:26.491730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN8EwZiIdaSHgJefVWHSlZ0UU8OX8R0aPtB8r1Pr3nfRFZLn6johVmlyimBuO6m2htmIzgGcwibHj5pfyrNspEC0yv0MbvK2BKJDTuaMjl6PU4M8pcs1czjr2NKHPBvNTiXqfyyojseF__WWl_lh7hlPx5Xw0WdfDj8zF_1x1MH7EsUY Oct 01 04:29:26.491730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:29:26.491730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:29:26.491730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:29:26.491730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:29:26.491730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:29:26.491730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:29:26.491730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: 57f927e7829a4172b9919b964a9e7c13 Oct 01 04:29:26.491730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:29:26.491730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:29:26.491730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:29:26.493386 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:29:26.493386 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:29:26.493386 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: 57f927e7829a4172b9919b964a9e7c13 Oct 01 04:29:26.493386 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:29:26.493386 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-AttachVolumeNegativeTest-41085015-project Oct 01 04:29:26.493386 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:29:26.493386 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:29:26.493386 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: 0e30d69a25494d70bc094eb92c4f9bb0 Oct 01 04:29:26.493386 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-AttachVolumeNegativeTest-41085015-project Oct 01 04:29:26.493386 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: > Oct 01 04:29:26.493386 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Instance 7666cbd6-6648-4f0b-ba58-7a95bd94700c could not be found. Oct 01 04:29:26.493386 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'id': '7666cbd6-6648-4f0b-ba58-7a95bd94700c'} Oct 01 04:29:26.494331 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:29:26.494331 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:29:26.494331 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:29:26.494331 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:29:26.494331 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:29:26.494331 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:29:26.494331 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:29:26.494331 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:29:26.494331 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:29:26.494331 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:29:26.494331 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7666cbd6-6648-4f0b-ba58-7a95bd94700c could not be found. Oct 01 04:29:26.494331 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:29:26.494331 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:29:26.494331 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:29:26.494331 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:29:26.494331 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:29:26.494331 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:29:26.494331 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:29:26.494331 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:29:26.494331 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:29:26.495859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:29:26.495859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 01 04:29:26.495859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 01 04:29:26.495859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 01 04:29:26.495859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 01 04:29:26.495859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:29:26.495859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:29:26.495859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:29:26.495859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:29:26.495859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7666cbd6-6648-4f0b-ba58-7a95bd94700c could not be found. Oct 01 04:29:26.495859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:29:26.495859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:29:26.495859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:29:26.495859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:29:26.495859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:29:26.495859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:29:26.495859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:29:26.495859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:29:26.495859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7666cbd6-6648-4f0b-ba58-7a95bd94700c could not be found. Oct 01 04:29:26.495859 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:29:26.498047 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-e16e7add-2cb6-4971-8b7b-3f899f30730f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Returning 404 to user: Instance 7666cbd6-6648-4f0b-ba58-7a95bd94700c could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:29:26.498047 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-e16e7add-2cb6-4971-8b7b-3f899f30730f tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c" status: 404 len: 111 microversion: 2.1 time: 0.030719 Oct 01 04:29:26.498047 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 535/1038] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 1 04:29:26 2022] DELETE /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:29:26.502188 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4654b4ba-9cec-435d-abac-11eb469a7fd7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:29:26.502811 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-4654b4ba-9cec-435d-abac-11eb469a7fd7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] [instance: 7666cbd6-6648-4f0b-ba58-7a95bd94700c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:29:26.509278 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4654b4ba-9cec-435d-abac-11eb469a7fd7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:26.509770 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4654b4ba-9cec-435d-abac-11eb469a7fd7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:26.510210 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4654b4ba-9cec-435d-abac-11eb469a7fd7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:26.510943 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4654b4ba-9cec-435d-abac-11eb469a7fd7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:29:26.511404 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4654b4ba-9cec-435d-abac-11eb469a7fd7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:29:26.511835 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-4654b4ba-9cec-435d-abac-11eb469a7fd7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:29:26.525676 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-4654b4ba-9cec-435d-abac-11eb469a7fd7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] HTTP exception thrown: Instance 7666cbd6-6648-4f0b-ba58-7a95bd94700c could not be found. Oct 01 04:29:26.527264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4654b4ba-9cec-435d-abac-11eb469a7fd7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Request method failure captured: Oct 01 04:29:26.527264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c HTTP/1.1 Oct 01 04:29:26.527264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept: application/json Oct 01 04:29:26.527264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept-Encoding: identity Oct 01 04:29:26.527264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Connection: close Oct 01 04:29:26.527264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Length: 0 Oct 01 04:29:26.527264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Type: application/json Oct 01 04:29:26.527264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Host: 10.222.0.26 Oct 01 04:29:26.527264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 01 04:29:26.527264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 01 04:29:26.527264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjN8EwZiIdaSHgJefVWHSlZ0UU8OX8R0aPtB8r1Pr3nfRFZLn6johVmlyimBuO6m2htmIzgGcwibHj5pfyrNspEC0yv0MbvK2BKJDTuaMjl6PU4M8pcs1czjr2NKHPBvNTiXqfyyojseF__WWl_lh7hlPx5Xw0WdfDj8zF_1x1MH7EsUY Oct 01 04:29:26.527264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Id: None Oct 01 04:29:26.527264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Name: None Oct 01 04:29:26.527264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 01 04:29:26.527264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 01 04:29:26.527264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 01 04:29:26.527264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 01 04:29:26.527264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Id: 57f927e7829a4172b9919b964a9e7c13 Oct 01 04:29:26.527264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Name: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:29:26.527264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Role: reader,member Oct 01 04:29:26.527264 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Roles: reader,member Oct 01 04:29:26.528969 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/57f927e7829a4172b9919b964a9e7c13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:29:26.528969 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:29:26.528969 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Id: 57f927e7829a4172b9919b964a9e7c13 Oct 01 04:29:26.528969 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-41085015 Oct 01 04:29:26.528969 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User: tempest-AttachVolumeNegativeTest-41085015-project Oct 01 04:29:26.528969 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 01 04:29:26.528969 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 01 04:29:26.528969 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Id: 0e30d69a25494d70bc094eb92c4f9bb0 Oct 01 04:29:26.528969 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Name: tempest-AttachVolumeNegativeTest-41085015-project Oct 01 04:29:26.528969 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: method: > Oct 01 04:29:26.528969 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: exception: Instance 7666cbd6-6648-4f0b-ba58-7a95bd94700c could not be found. Oct 01 04:29:26.528969 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: action_args: {'id': '7666cbd6-6648-4f0b-ba58-7a95bd94700c'} Oct 01 04:29:26.529967 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:29:26.529967 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:29:26.529967 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:29:26.529967 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:29:26.529967 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:29:26.529967 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:29:26.529967 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:29:26.529967 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:29:26.529967 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:29:26.529967 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:29:26.529967 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7666cbd6-6648-4f0b-ba58-7a95bd94700c could not be found. Oct 01 04:29:26.529967 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:29:26.529967 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:29:26.529967 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:29:26.529967 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:29:26.529967 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:29:26.529967 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:29:26.529967 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:29:26.529967 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:29:26.529967 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:29:26.531628 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:29:26.531628 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:29:26.531628 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:29:26.531628 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:29:26.531628 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:29:26.531628 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:29:26.531628 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:29:26.531628 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7666cbd6-6648-4f0b-ba58-7a95bd94700c could not be found. Oct 01 04:29:26.531628 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:29:26.531628 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:29:26.531628 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:29:26.531628 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:29:26.531628 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:29:26.531628 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:29:26.531628 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:29:26.531628 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:29:26.531628 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7666cbd6-6648-4f0b-ba58-7a95bd94700c could not be found. Oct 01 04:29:26.531628 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:29:26.533135 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-4654b4ba-9cec-435d-abac-11eb469a7fd7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] Returning 404 to user: Instance 7666cbd6-6648-4f0b-ba58-7a95bd94700c could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:29:26.533135 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-4654b4ba-9cec-435d-abac-11eb469a7fd7 tempest-AttachVolumeNegativeTest-41085015 tempest-AttachVolumeNegativeTest-41085015-project] 10.222.0.26 "GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c" status: 404 len: 111 microversion: 2.1 time: 0.030530 Oct 01 04:29:26.533135 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 504/1039] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:29:26 2022] GET /compute/v2.1/servers/7666cbd6-6648-4f0b-ba58-7a95bd94700c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:30:16.553688 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-3b613b98-c37f-4729-9286-eb407a5aaa6d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-231577199", "imageRef": "c63d52d7-4e3d-40cf-a8b5-59a2d027d793", "flavorRef": "452", "networks": [{"uuid": "4153c2bf-cbb3-485c-bf95-921ca0607fc3"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:30:16.562418 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=20 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:30:16.563066 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:30:16.611759 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-3b613b98-c37f-4729-9286-eb407a5aaa6d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] validate_networks() for [('4153c2bf-cbb3-485c-bf95-921ca0607fc3', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 04:30:17.001934 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-3b613b98-c37f-4729-9286-eb407a5aaa6d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 04:30:17.002366 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-3b613b98-c37f-4729-9286-eb407a5aaa6d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 04:30:17.002845 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-3b613b98-c37f-4729-9286-eb407a5aaa6d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 04:30:17.003261 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-3b613b98-c37f-4729-9286-eb407a5aaa6d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 04:30:17.003680 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-3b613b98-c37f-4729-9286-eb407a5aaa6d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 04:30:17.012330 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b613b98-c37f-4729-9286-eb407a5aaa6d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:30:17.012816 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b613b98-c37f-4729-9286-eb407a5aaa6d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:30:17.013285 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b613b98-c37f-4729-9286-eb407a5aaa6d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:30:17.014017 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b613b98-c37f-4729-9286-eb407a5aaa6d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:30:17.014475 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b613b98-c37f-4729-9286-eb407a5aaa6d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:30:17.014938 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-3b613b98-c37f-4729-9286-eb407a5aaa6d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:30:17.031744 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-3b613b98-c37f-4729-9286-eb407a5aaa6d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Getting quotas for project c465c8ca23c943ab87092a9544383677. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:30:17.036487 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-3b613b98-c37f-4729-9286-eb407a5aaa6d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Getting quotas for user e27ccd9a0974420389d2216ca0590082 and project c465c8ca23c943ab87092a9544383677. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:30:17.047301 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3b613b98-c37f-4729-9286-eb407a5aaa6d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 04:30:17.050327 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-3b613b98-c37f-4729-9286-eb407a5aaa6d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 2a39ac89-d27e-4866-ae18-130bc363c05c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c63d52d7-4e3d-40cf-a8b5-59a2d027d793',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 04:30:17.095540 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-3b613b98-c37f-4729-9286-eb407a5aaa6d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545209 Oct 01 04:30:17.096190 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 536/1040] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 1 04:30:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 04:30:17.107378 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-95f5367b-8fd5-4651-843f-c8eb0d3e5d41 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:30:17.108082 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-95f5367b-8fd5-4651-843f-c8eb0d3e5d41 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 2a39ac89-d27e-4866-ae18-130bc363c05c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:30:17.110948 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:30:17.111676 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:30:17.170645 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-95f5367b-8fd5-4651-843f-c8eb0d3e5d41 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27ccd9a0974420389d2216ca0590082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c8ca23c943ab87092a9544383677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:30:17.177976 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-95f5367b-8fd5-4651-843f-c8eb0d3e5d41 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "GET /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c" status: 200 len: 1218 microversion: 2.1 time: 0.074582 Oct 01 04:30:17.178563 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 505/1041] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:30:17 2022] GET /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:30:18.211245 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-0166a02d-a419-4965-9af4-a989148ec219 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:30:18.216715 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-0166a02d-a419-4965-9af4-a989148ec219 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 2a39ac89-d27e-4866-ae18-130bc363c05c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:30:18.227089 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0166a02d-a419-4965-9af4-a989148ec219 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:30:18.227965 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0166a02d-a419-4965-9af4-a989148ec219 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:30:18.228492 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0166a02d-a419-4965-9af4-a989148ec219 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:30:18.229449 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0166a02d-a419-4965-9af4-a989148ec219 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:30:18.230134 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0166a02d-a419-4965-9af4-a989148ec219 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:30:18.230664 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-0166a02d-a419-4965-9af4-a989148ec219 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:30:18.303866 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-0166a02d-a419-4965-9af4-a989148ec219 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27ccd9a0974420389d2216ca0590082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c8ca23c943ab87092a9544383677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:30:18.312574 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-0166a02d-a419-4965-9af4-a989148ec219 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "GET /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c" status: 200 len: 1288 microversion: 2.1 time: 0.112485 Oct 01 04:30:18.313865 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 537/1042] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:30:18 2022] GET /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c => generated 1288 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:30:19.339336 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d324a171-88cd-477b-bcbf-377ae0ae68ad tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:30:19.339940 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d324a171-88cd-477b-bcbf-377ae0ae68ad tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 2a39ac89-d27e-4866-ae18-130bc363c05c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:30:19.348327 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d324a171-88cd-477b-bcbf-377ae0ae68ad tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:30:19.348827 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d324a171-88cd-477b-bcbf-377ae0ae68ad tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:30:19.349303 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d324a171-88cd-477b-bcbf-377ae0ae68ad tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:30:19.350199 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d324a171-88cd-477b-bcbf-377ae0ae68ad tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:30:19.351040 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d324a171-88cd-477b-bcbf-377ae0ae68ad tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:30:19.351632 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d324a171-88cd-477b-bcbf-377ae0ae68ad tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:30:19.489112 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-d324a171-88cd-477b-bcbf-377ae0ae68ad tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27ccd9a0974420389d2216ca0590082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c8ca23c943ab87092a9544383677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:30:19.497393 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d324a171-88cd-477b-bcbf-377ae0ae68ad tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "GET /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c" status: 200 len: 1318 microversion: 2.1 time: 0.162839 Oct 01 04:30:19.497958 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 506/1043] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:30:19 2022] GET /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:30:19.602135 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-77c8baff-f429-479b-998b-f9a0aa085985 req-5520f72b-417e-45a1-8d05-5ec4411e8888 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a39ac89-d27e-4866-ae18-130bc363c05c", "tag": "304ccc01-fc3d-4d39-a60a-8fdf78522c34"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:30:19.612674 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-77c8baff-f429-479b-998b-f9a0aa085985 req-5520f72b-417e-45a1-8d05-5ec4411e8888 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:30:19.613371 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-77c8baff-f429-479b-998b-f9a0aa085985 req-5520f72b-417e-45a1-8d05-5ec4411e8888 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:30:19.613671 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-77c8baff-f429-479b-998b-f9a0aa085985 req-5520f72b-417e-45a1-8d05-5ec4411e8888 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:30:19.625023 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-77c8baff-f429-479b-998b-f9a0aa085985 req-5520f72b-417e-45a1-8d05-5ec4411e8888 service nova] Creating event network-changed:304ccc01-fc3d-4d39-a60a-8fdf78522c34 for instance 2a39ac89-d27e-4866-ae18-130bc363c05c on hv-cinder-86004 Oct 01 04:30:19.630966 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-77c8baff-f429-479b-998b-f9a0aa085985 req-5520f72b-417e-45a1-8d05-5ec4411e8888 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032477 Oct 01 04:30:19.631580 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 538/1044] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:30:20.522042 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-a19d5b4a-298e-41c9-8fdd-f265417144eb tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:30:20.523084 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-a19d5b4a-298e-41c9-8fdd-f265417144eb tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 2a39ac89-d27e-4866-ae18-130bc363c05c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:30:20.529007 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a19d5b4a-298e-41c9-8fdd-f265417144eb tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:30:20.529496 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a19d5b4a-298e-41c9-8fdd-f265417144eb tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:30:20.529959 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a19d5b4a-298e-41c9-8fdd-f265417144eb tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:30:20.530648 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a19d5b4a-298e-41c9-8fdd-f265417144eb tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:30:20.531107 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a19d5b4a-298e-41c9-8fdd-f265417144eb tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:30:20.531531 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-a19d5b4a-298e-41c9-8fdd-f265417144eb tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:30:20.662060 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-a19d5b4a-298e-41c9-8fdd-f265417144eb tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27ccd9a0974420389d2216ca0590082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c8ca23c943ab87092a9544383677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:30:20.669691 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-a19d5b4a-298e-41c9-8fdd-f265417144eb tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "GET /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c" status: 200 len: 1318 microversion: 2.1 time: 0.151767 Oct 01 04:30:20.670276 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 507/1045] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:30:20 2022] GET /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:30:21.694697 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f8cadbe7-3c9d-43c6-a080-2b117968c4a9 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:30:21.695391 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f8cadbe7-3c9d-43c6-a080-2b117968c4a9 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 2a39ac89-d27e-4866-ae18-130bc363c05c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:30:21.701567 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8cadbe7-3c9d-43c6-a080-2b117968c4a9 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:30:21.702049 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8cadbe7-3c9d-43c6-a080-2b117968c4a9 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:30:21.702490 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8cadbe7-3c9d-43c6-a080-2b117968c4a9 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:30:21.703165 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8cadbe7-3c9d-43c6-a080-2b117968c4a9 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:30:21.703616 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8cadbe7-3c9d-43c6-a080-2b117968c4a9 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:30:21.704060 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f8cadbe7-3c9d-43c6-a080-2b117968c4a9 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:30:21.837393 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f8cadbe7-3c9d-43c6-a080-2b117968c4a9 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27ccd9a0974420389d2216ca0590082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c8ca23c943ab87092a9544383677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:30:21.844990 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f8cadbe7-3c9d-43c6-a080-2b117968c4a9 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "GET /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c" status: 200 len: 1318 microversion: 2.1 time: 0.154870 Oct 01 04:30:21.845550 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 539/1046] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:30:21 2022] GET /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 01 04:30:22.867352 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-88fdd3e4-8338-4505-8c6c-4aa50a89621d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:30:22.867891 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-88fdd3e4-8338-4505-8c6c-4aa50a89621d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 2a39ac89-d27e-4866-ae18-130bc363c05c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:30:22.874251 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88fdd3e4-8338-4505-8c6c-4aa50a89621d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:30:22.874735 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88fdd3e4-8338-4505-8c6c-4aa50a89621d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:30:22.875175 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88fdd3e4-8338-4505-8c6c-4aa50a89621d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:30:22.875916 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88fdd3e4-8338-4505-8c6c-4aa50a89621d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:30:22.876371 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88fdd3e4-8338-4505-8c6c-4aa50a89621d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:30:22.876793 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-88fdd3e4-8338-4505-8c6c-4aa50a89621d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:30:23.007390 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-88fdd3e4-8338-4505-8c6c-4aa50a89621d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27ccd9a0974420389d2216ca0590082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c8ca23c943ab87092a9544383677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:30:23.015013 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-88fdd3e4-8338-4505-8c6c-4aa50a89621d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "GET /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c" status: 200 len: 1318 microversion: 2.1 time: 0.151578 Oct 01 04:30:23.015575 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 508/1047] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:30:22 2022] GET /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:30:24.038743 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-c7efe68d-a0f1-4e45-be91-4e57e74a97b9 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:30:24.039984 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-c7efe68d-a0f1-4e45-be91-4e57e74a97b9 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 2a39ac89-d27e-4866-ae18-130bc363c05c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:30:24.047946 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7efe68d-a0f1-4e45-be91-4e57e74a97b9 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:30:24.048073 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7efe68d-a0f1-4e45-be91-4e57e74a97b9 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:30:24.048681 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7efe68d-a0f1-4e45-be91-4e57e74a97b9 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:30:24.049632 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7efe68d-a0f1-4e45-be91-4e57e74a97b9 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:30:24.050102 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7efe68d-a0f1-4e45-be91-4e57e74a97b9 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:30:24.050538 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-c7efe68d-a0f1-4e45-be91-4e57e74a97b9 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:30:24.176756 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-f2d78e79-631e-4c75-bf2d-a4a9f732fe25 req-5c40f631-a38f-4f6f-97c2-51fff58ba00e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a39ac89-d27e-4866-ae18-130bc363c05c", "name": "network-vif-plugged", "status": "completed", "tag": "304ccc01-fc3d-4d39-a60a-8fdf78522c34"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:30:24.187122 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f2d78e79-631e-4c75-bf2d-a4a9f732fe25 req-5c40f631-a38f-4f6f-97c2-51fff58ba00e service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:30:24.187603 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f2d78e79-631e-4c75-bf2d-a4a9f732fe25 req-5c40f631-a38f-4f6f-97c2-51fff58ba00e service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:30:24.188063 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-f2d78e79-631e-4c75-bf2d-a4a9f732fe25 req-5c40f631-a38f-4f6f-97c2-51fff58ba00e service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:30:24.195105 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-c7efe68d-a0f1-4e45-be91-4e57e74a97b9 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27ccd9a0974420389d2216ca0590082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c8ca23c943ab87092a9544383677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:30:24.199696 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-f2d78e79-631e-4c75-bf2d-a4a9f732fe25 req-5c40f631-a38f-4f6f-97c2-51fff58ba00e service nova] Creating event network-vif-plugged:304ccc01-fc3d-4d39-a60a-8fdf78522c34 for instance 2a39ac89-d27e-4866-ae18-130bc363c05c on hv-cinder-86004 Oct 01 04:30:24.203101 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-c7efe68d-a0f1-4e45-be91-4e57e74a97b9 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "GET /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c" status: 200 len: 1318 microversion: 2.1 time: 0.168242 Oct 01 04:30:24.203737 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 540/1048] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:30:24 2022] GET /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:30:24.205042 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-f2d78e79-631e-4c75-bf2d-a4a9f732fe25 req-5c40f631-a38f-4f6f-97c2-51fff58ba00e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164084 Oct 01 04:30:24.205618 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 509/1049] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 01 04:30:25.226473 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-2e16239b-b1c6-443a-91e0-38d1285140ef tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:30:25.227160 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-2e16239b-b1c6-443a-91e0-38d1285140ef tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 2a39ac89-d27e-4866-ae18-130bc363c05c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:30:25.233668 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e16239b-b1c6-443a-91e0-38d1285140ef tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:30:25.234146 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e16239b-b1c6-443a-91e0-38d1285140ef tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:30:25.234577 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e16239b-b1c6-443a-91e0-38d1285140ef tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:30:25.235295 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e16239b-b1c6-443a-91e0-38d1285140ef tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:30:25.235743 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e16239b-b1c6-443a-91e0-38d1285140ef tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:30:25.236175 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-2e16239b-b1c6-443a-91e0-38d1285140ef tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:30:25.369170 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-2e16239b-b1c6-443a-91e0-38d1285140ef tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27ccd9a0974420389d2216ca0590082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c8ca23c943ab87092a9544383677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:30:25.377434 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-2e16239b-b1c6-443a-91e0-38d1285140ef tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "GET /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c" status: 200 len: 1318 microversion: 2.1 time: 0.154809 Oct 01 04:30:25.378006 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 541/1050] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:30:25 2022] GET /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:30:26.401843 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-96519f2b-3444-422a-bfa3-7e601039f3ed tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:30:26.402542 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-96519f2b-3444-422a-bfa3-7e601039f3ed tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 2a39ac89-d27e-4866-ae18-130bc363c05c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:30:26.409660 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96519f2b-3444-422a-bfa3-7e601039f3ed tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:30:26.410140 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96519f2b-3444-422a-bfa3-7e601039f3ed tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:30:26.410573 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96519f2b-3444-422a-bfa3-7e601039f3ed tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:30:26.411254 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96519f2b-3444-422a-bfa3-7e601039f3ed tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:30:26.411709 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96519f2b-3444-422a-bfa3-7e601039f3ed tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:30:26.412127 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-96519f2b-3444-422a-bfa3-7e601039f3ed tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:30:26.540012 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-96519f2b-3444-422a-bfa3-7e601039f3ed tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27ccd9a0974420389d2216ca0590082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c8ca23c943ab87092a9544383677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:30:26.547767 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-96519f2b-3444-422a-bfa3-7e601039f3ed tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "GET /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c" status: 200 len: 1506 microversion: 2.1 time: 0.150684 Oct 01 04:30:26.548330 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 510/1051] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:30:26 2022] GET /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:30:40.727975 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-6203d6d6-d847-4e67-b30b-a8d8939b47f3 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5fbb1ef-eaa5-4e7f-aee1-7de6edcb995c", "device": "/dev/sdb"}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:30:40.730832 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-6203d6d6-d847-4e67-b30b-a8d8939b47f3 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 2a39ac89-d27e-4866-ae18-130bc363c05c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:30:40.732997 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:30:40.733648 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=6 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:30:40.734603 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:30:40.735388 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=28 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:30:40.741637 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6203d6d6-d847-4e67-b30b-a8d8939b47f3 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:30:40.742128 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6203d6d6-d847-4e67-b30b-a8d8939b47f3 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:30:40.742586 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6203d6d6-d847-4e67-b30b-a8d8939b47f3 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:30:40.743280 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6203d6d6-d847-4e67-b30b-a8d8939b47f3 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:30:40.743734 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6203d6d6-d847-4e67-b30b-a8d8939b47f3 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:30:40.744156 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-6203d6d6-d847-4e67-b30b-a8d8939b47f3 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:30:40.993360 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-6203d6d6-d847-4e67-b30b-a8d8939b47f3 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "POST /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268630 Oct 01 04:30:40.999203 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 542/1052] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 1 04:30:40 2022] POST /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:31:02.669607 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-dc1cf3e9-c1a0-4a63-905d-610ce064aaa3 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:31:02.670123 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-dc1cf3e9-c1a0-4a63-905d-610ce064aaa3 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 2a39ac89-d27e-4866-ae18-130bc363c05c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:31:02.672268 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=2 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:31:02.673092 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=14 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:31:02.673682 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=26 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:31:02.680496 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc1cf3e9-c1a0-4a63-905d-610ce064aaa3 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:02.681011 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc1cf3e9-c1a0-4a63-905d-610ce064aaa3 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:02.681455 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc1cf3e9-c1a0-4a63-905d-610ce064aaa3 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:02.682153 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc1cf3e9-c1a0-4a63-905d-610ce064aaa3 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:02.682617 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc1cf3e9-c1a0-4a63-905d-610ce064aaa3 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:02.683045 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-dc1cf3e9-c1a0-4a63-905d-610ce064aaa3 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:02.769802 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-dc1cf3e9-c1a0-4a63-905d-610ce064aaa3 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lazy-loading 'services' on Instance uuid 2a39ac89-d27e-4866-ae18-130bc363c05c {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:31:02.842208 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-dc1cf3e9-c1a0-4a63-905d-610ce064aaa3 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c/os-volume_attachments/e5fbb1ef-eaa5-4e7f-aee1-7de6edcb995c" status: 202 len: 0 microversion: 2.1 time: 0.176625 Oct 01 04:31:02.842794 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 511/1053] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 1 04:31:02 2022] DELETE /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c/os-volume_attachments/e5fbb1ef-eaa5-4e7f-aee1-7de6edcb995c => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 04:31:03.961834 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:31:03.962741 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:31:03.967412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-1445985d-2f08-4737-8f47-87eec1b61325 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:31:03.967994 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1445985d-2f08-4737-8f47-87eec1b61325 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 2a39ac89-d27e-4866-ae18-130bc363c05c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:31:03.975016 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1445985d-2f08-4737-8f47-87eec1b61325 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:03.975497 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1445985d-2f08-4737-8f47-87eec1b61325 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:03.975927 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1445985d-2f08-4737-8f47-87eec1b61325 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:03.976610 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1445985d-2f08-4737-8f47-87eec1b61325 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:03.977089 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1445985d-2f08-4737-8f47-87eec1b61325 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:03.977513 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-1445985d-2f08-4737-8f47-87eec1b61325 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:04.003477 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-1445985d-2f08-4737-8f47-87eec1b61325 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 2a39ac89-d27e-4866-ae18-130bc363c05c] Going to try to terminate instance {{(pid=120598) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 04:31:04.079751 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-1445985d-2f08-4737-8f47-87eec1b61325 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c" status: 204 len: 0 microversion: 2.1 time: 0.118862 Oct 01 04:31:04.080547 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 543/1054] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 1 04:31:03 2022] DELETE /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 04:31:04.091096 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-03042e95-e238-4f75-9521-38f4fb5665e7 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:31:04.091800 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-03042e95-e238-4f75-9521-38f4fb5665e7 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 2a39ac89-d27e-4866-ae18-130bc363c05c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:31:04.097892 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03042e95-e238-4f75-9521-38f4fb5665e7 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:04.098372 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03042e95-e238-4f75-9521-38f4fb5665e7 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:04.098806 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03042e95-e238-4f75-9521-38f4fb5665e7 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:04.099492 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03042e95-e238-4f75-9521-38f4fb5665e7 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:04.099955 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03042e95-e238-4f75-9521-38f4fb5665e7 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:04.100380 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-03042e95-e238-4f75-9521-38f4fb5665e7 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:04.228564 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-03042e95-e238-4f75-9521-38f4fb5665e7 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27ccd9a0974420389d2216ca0590082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c8ca23c943ab87092a9544383677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:31:04.236795 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-03042e95-e238-4f75-9521-38f4fb5665e7 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "GET /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c" status: 200 len: 1512 microversion: 2.1 time: 0.151222 Oct 01 04:31:04.237405 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 512/1055] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:31:04 2022] GET /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:31:05.261072 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-f5c68f4f-f087-461e-8af8-0dd862891e3d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:31:05.262523 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-f5c68f4f-f087-461e-8af8-0dd862891e3d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 2a39ac89-d27e-4866-ae18-130bc363c05c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:31:05.269113 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5c68f4f-f087-461e-8af8-0dd862891e3d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:05.269592 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5c68f4f-f087-461e-8af8-0dd862891e3d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:05.270023 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5c68f4f-f087-461e-8af8-0dd862891e3d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:05.270708 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5c68f4f-f087-461e-8af8-0dd862891e3d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:05.271188 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5c68f4f-f087-461e-8af8-0dd862891e3d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:05.271609 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-f5c68f4f-f087-461e-8af8-0dd862891e3d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:05.402171 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-f5c68f4f-f087-461e-8af8-0dd862891e3d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27ccd9a0974420389d2216ca0590082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c8ca23c943ab87092a9544383677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:31:05.411549 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-f5c68f4f-f087-461e-8af8-0dd862891e3d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "GET /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c" status: 200 len: 1512 microversion: 2.1 time: 0.154622 Oct 01 04:31:05.412247 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 544/1056] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:31:05 2022] GET /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:31:06.243287 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-9fdd17e7-3e27-490b-b165-1fd2a465a05c req-0b48fc04-7ca9-46b9-9939-28da8bca801f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a39ac89-d27e-4866-ae18-130bc363c05c", "name": "network-vif-deleted", "tag": "304ccc01-fc3d-4d39-a60a-8fdf78522c34"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:31:06.254015 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9fdd17e7-3e27-490b-b165-1fd2a465a05c req-0b48fc04-7ca9-46b9-9939-28da8bca801f service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:06.254504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9fdd17e7-3e27-490b-b165-1fd2a465a05c req-0b48fc04-7ca9-46b9-9939-28da8bca801f service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:06.254919 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-9fdd17e7-3e27-490b-b165-1fd2a465a05c req-0b48fc04-7ca9-46b9-9939-28da8bca801f service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:06.267691 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-9fdd17e7-3e27-490b-b165-1fd2a465a05c req-0b48fc04-7ca9-46b9-9939-28da8bca801f service nova] Creating event network-vif-deleted:304ccc01-fc3d-4d39-a60a-8fdf78522c34 for instance 2a39ac89-d27e-4866-ae18-130bc363c05c on hv-cinder-86004 Oct 01 04:31:06.273335 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-9fdd17e7-3e27-490b-b165-1fd2a465a05c req-0b48fc04-7ca9-46b9-9939-28da8bca801f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033643 Oct 01 04:31:06.273972 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 513/1057] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:31:06.435824 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-dc1fb10b-85ea-4eb7-8421-92eeb634a283 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:31:06.436432 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-dc1fb10b-85ea-4eb7-8421-92eeb634a283 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 2a39ac89-d27e-4866-ae18-130bc363c05c] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:31:06.442921 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc1fb10b-85ea-4eb7-8421-92eeb634a283 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:06.443402 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc1fb10b-85ea-4eb7-8421-92eeb634a283 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:06.443839 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc1fb10b-85ea-4eb7-8421-92eeb634a283 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:06.444522 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc1fb10b-85ea-4eb7-8421-92eeb634a283 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:06.444999 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc1fb10b-85ea-4eb7-8421-92eeb634a283 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:06.445419 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc1fb10b-85ea-4eb7-8421-92eeb634a283 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:06.476335 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc1fb10b-85ea-4eb7-8421-92eeb634a283 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:06.476811 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc1fb10b-85ea-4eb7-8421-92eeb634a283 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:06.477302 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-dc1fb10b-85ea-4eb7-8421-92eeb634a283 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:06.477743 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-dc1fb10b-85ea-4eb7-8421-92eeb634a283 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lazy-loading 'fault' on Instance uuid 2a39ac89-d27e-4866-ae18-130bc363c05c {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:31:06.518390 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-dc1fb10b-85ea-4eb7-8421-92eeb634a283 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27ccd9a0974420389d2216ca0590082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c8ca23c943ab87092a9544383677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:31:06.526609 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-dc1fb10b-85ea-4eb7-8421-92eeb634a283 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "GET /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c" status: 200 len: 1308 microversion: 2.1 time: 0.095287 Oct 01 04:31:06.527198 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 545/1058] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:31:06 2022] GET /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:31:07.550392 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9fc5ba61-2f5b-4598-b4e2-c104592f6bb4 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:31:07.551108 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-9fc5ba61-2f5b-4598-b4e2-c104592f6bb4 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 2a39ac89-d27e-4866-ae18-130bc363c05c] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:31:07.557292 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fc5ba61-2f5b-4598-b4e2-c104592f6bb4 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:07.557779 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fc5ba61-2f5b-4598-b4e2-c104592f6bb4 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:07.558222 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fc5ba61-2f5b-4598-b4e2-c104592f6bb4 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:07.558922 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fc5ba61-2f5b-4598-b4e2-c104592f6bb4 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:07.559384 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fc5ba61-2f5b-4598-b4e2-c104592f6bb4 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:07.559843 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-9fc5ba61-2f5b-4598-b4e2-c104592f6bb4 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:07.575156 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.wsgi [None req-9fc5ba61-2f5b-4598-b4e2-c104592f6bb4 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] HTTP exception thrown: Instance 2a39ac89-d27e-4866-ae18-130bc363c05c could not be found. Oct 01 04:31:07.576765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9fc5ba61-2f5b-4598-b4e2-c104592f6bb4 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Request method failure captured: Oct 01 04:31:07.576765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: request: GET /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c HTTP/1.1 Oct 01 04:31:07.576765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept: application/json Oct 01 04:31:07.576765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Accept-Encoding: identity Oct 01 04:31:07.576765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Connection: close Oct 01 04:31:07.576765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Length: 0 Oct 01 04:31:07.576765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Content-Type: application/json Oct 01 04:31:07.576765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Host: 10.222.0.26 Oct 01 04:31:07.576765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: Openstack-System-Scope: None Oct 01 04:31:07.576765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: User-Agent: python-urllib3/1.26.12 Oct 01 04:31:07.576765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Auth-Token: gAAAAABjN8JW12Ytw6r6ZZPCYFNtcAjmRJQ8rkkQDjPpx-wJVYSC5E6f0RjW_4WbmUOQK31NFA9TyLFr7TzuTagI7VuqvNmbXtrNfYUybMDiQ3M8P7dTmB-0FuPvqOm-dHAtdIThYfPXivLBSroyUFmHt-DwUD2cZSr43RafKqFzcNNceTHAcfs Oct 01 04:31:07.576765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Id: None Oct 01 04:31:07.576765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Domain-Name: None Oct 01 04:31:07.576765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Identity-Status: Confirmed Oct 01 04:31:07.576765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Is-Admin-Project: True Oct 01 04:31:07.576765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Id: default Oct 01 04:31:07.576765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Domain-Name: Default Oct 01 04:31:07.576765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Id: c465c8ca23c943ab87092a9544383677 Oct 01 04:31:07.576765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Project-Name: tempest-VolumesSnapshotTestJSON-745650261 Oct 01 04:31:07.576765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Role: reader,member Oct 01 04:31:07.576765 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Roles: reader,member Oct 01 04:31:07.578686 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c465c8ca23c943ab87092a9544383677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c465c8ca23c943ab87092a9544383677"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c465c8ca23c943ab87092a9544383677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c465c8ca23c943ab87092a9544383677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:31:07.578686 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant: tempest-VolumesSnapshotTestJSON-745650261 Oct 01 04:31:07.578686 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Id: c465c8ca23c943ab87092a9544383677 Oct 01 04:31:07.578686 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-745650261 Oct 01 04:31:07.578686 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User: tempest-VolumesSnapshotTestJSON-745650261-project Oct 01 04:31:07.578686 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Id: default Oct 01 04:31:07.578686 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Domain-Name: Default Oct 01 04:31:07.578686 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Id: e27ccd9a0974420389d2216ca0590082 Oct 01 04:31:07.578686 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: X-User-Name: tempest-VolumesSnapshotTestJSON-745650261-project Oct 01 04:31:07.578686 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: method: > Oct 01 04:31:07.578686 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: exception: Instance 2a39ac89-d27e-4866-ae18-130bc363c05c could not be found. Oct 01 04:31:07.578686 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: action_args: {'id': '2a39ac89-d27e-4866-ae18-130bc363c05c'} Oct 01 04:31:07.579928 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:31:07.579928 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:31:07.579928 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:31:07.579928 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:31:07.579928 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:31:07.579928 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:31:07.579928 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:31:07.579928 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:31:07.579928 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:31:07.579928 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:31:07.579928 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a39ac89-d27e-4866-ae18-130bc363c05c could not be found. Oct 01 04:31:07.579928 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:31:07.579928 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:31:07.579928 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:31:07.579928 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:31:07.579928 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:31:07.579928 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:31:07.579928 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:31:07.579928 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:31:07.579928 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:31:07.581627 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:31:07.581627 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:31:07.581627 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:31:07.581627 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:31:07.581627 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:31:07.581627 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:31:07.581627 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:31:07.581627 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a39ac89-d27e-4866-ae18-130bc363c05c could not be found. Oct 01 04:31:07.581627 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:31:07.581627 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:31:07.581627 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:31:07.581627 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:31:07.581627 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:31:07.581627 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:31:07.581627 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:31:07.581627 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:31:07.581627 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a39ac89-d27e-4866-ae18-130bc363c05c could not be found. Oct 01 04:31:07.581627 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: ERROR nova.api.openstack.wsgi Oct 01 04:31:07.583209 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-9fc5ba61-2f5b-4598-b4e2-c104592f6bb4 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Returning 404 to user: Instance 2a39ac89-d27e-4866-ae18-130bc363c05c could not be found. {{(pid=120597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:31:07.583209 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-9fc5ba61-2f5b-4598-b4e2-c104592f6bb4 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "GET /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c" status: 404 len: 111 microversion: 2.1 time: 0.032517 Oct 01 04:31:07.583209 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 514/1059] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:31:07 2022] GET /compute/v2.1/servers/2a39ac89-d27e-4866-ae18-130bc363c05c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 01 04:31:15.563782 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-37bb79a4-f7d6-4988-acdd-d69daa4de26e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-133513285", "imageRef": "c63d52d7-4e3d-40cf-a8b5-59a2d027d793", "flavorRef": "452", "networks": [{"uuid": "4153c2bf-cbb3-485c-bf95-921ca0607fc3"}]}} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:31:15.618180 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.network.neutron [None req-37bb79a4-f7d6-4988-acdd-d69daa4de26e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] validate_networks() for [('4153c2bf-cbb3-485c-bf95-921ca0607fc3', None, None, None, None, None)] {{(pid=120598) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 01 04:31:15.962261 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-37bb79a4-f7d6-4988-acdd-d69daa4de26e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Flavor limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 01 04:31:15.962692 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-37bb79a4-f7d6-4988-acdd-d69daa4de26e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Image limits 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 01 04:31:15.963170 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-37bb79a4-f7d6-4988-acdd-d69daa4de26e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Flavor pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 01 04:31:15.963581 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-37bb79a4-f7d6-4988-acdd-d69daa4de26e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Image pref 0:0:0 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 01 04:31:15.963994 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.virt.hardware [None req-37bb79a4-f7d6-4988-acdd-d69daa4de26e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 01 04:31:15.973351 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37bb79a4-f7d6-4988-acdd-d69daa4de26e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:15.973832 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37bb79a4-f7d6-4988-acdd-d69daa4de26e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:15.974264 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37bb79a4-f7d6-4988-acdd-d69daa4de26e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:15.975014 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37bb79a4-f7d6-4988-acdd-d69daa4de26e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:15.975474 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37bb79a4-f7d6-4988-acdd-d69daa4de26e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:15.975897 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-37bb79a4-f7d6-4988-acdd-d69daa4de26e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:15.993078 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-37bb79a4-f7d6-4988-acdd-d69daa4de26e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Getting quotas for project c465c8ca23c943ab87092a9544383677. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 01 04:31:15.997011 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.quota [None req-37bb79a4-f7d6-4988-acdd-d69daa4de26e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Getting quotas for user e27ccd9a0974420389d2216ca0590082 and project c465c8ca23c943ab87092a9544383677. Resources: {'ram', 'cores', 'instances'} {{(pid=120598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 01 04:31:16.009004 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-37bb79a4-f7d6-4988-acdd-d69daa4de26e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Going to run 1 instances... {{(pid=120598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 01 04:31:16.011242 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-37bb79a4-f7d6-4988-acdd-d69daa4de26e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 72808e6d-f907-44b2-b094-27e432fb5e6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c63d52d7-4e3d-40cf-a8b5-59a2d027d793',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 01 04:31:16.057132 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-37bb79a4-f7d6-4988-acdd-d69daa4de26e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.497993 Oct 01 04:31:16.057778 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 546/1060] 10.222.0.26 () {60 vars in 1147 bytes} [Sat Oct 1 04:31:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 01 04:31:16.069419 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-42b0ef53-732a-40c8-874f-2211964ce2fa tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:31:16.070087 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-42b0ef53-732a-40c8-874f-2211964ce2fa tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 72808e6d-f907-44b2-b094-27e432fb5e6e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:31:16.123314 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-42b0ef53-732a-40c8-874f-2211964ce2fa tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27ccd9a0974420389d2216ca0590082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c8ca23c943ab87092a9544383677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:31:16.130095 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-42b0ef53-732a-40c8-874f-2211964ce2fa tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e" status: 200 len: 1218 microversion: 2.1 time: 0.064522 Oct 01 04:31:16.130659 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 515/1061] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:31:16 2022] GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:31:17.152726 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-179666f0-6186-4d9a-8a8b-62c51e2b9a39 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:31:17.153369 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-179666f0-6186-4d9a-8a8b-62c51e2b9a39 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 72808e6d-f907-44b2-b094-27e432fb5e6e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:31:17.211298 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-179666f0-6186-4d9a-8a8b-62c51e2b9a39 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27ccd9a0974420389d2216ca0590082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c8ca23c943ab87092a9544383677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:31:17.221021 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-179666f0-6186-4d9a-8a8b-62c51e2b9a39 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e" status: 200 len: 1218 microversion: 2.1 time: 0.072031 Oct 01 04:31:17.221706 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 547/1062] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:31:17 2022] GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:31:18.244129 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-88132282-e926-48fc-8385-3c9cc804340e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:31:18.244769 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-88132282-e926-48fc-8385-3c9cc804340e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 72808e6d-f907-44b2-b094-27e432fb5e6e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:31:18.247200 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:31:18.302625 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-88132282-e926-48fc-8385-3c9cc804340e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27ccd9a0974420389d2216ca0590082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c8ca23c943ab87092a9544383677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:31:18.310024 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-88132282-e926-48fc-8385-3c9cc804340e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e" status: 200 len: 1218 microversion: 2.1 time: 0.069673 Oct 01 04:31:18.310592 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 516/1063] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:31:18 2022] GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:31:19.333530 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-63ff8a55-f0d7-4250-985a-5f286f928e0c tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:31:19.334151 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-63ff8a55-f0d7-4250-985a-5f286f928e0c tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 72808e6d-f907-44b2-b094-27e432fb5e6e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:31:19.387712 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-63ff8a55-f0d7-4250-985a-5f286f928e0c tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27ccd9a0974420389d2216ca0590082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c8ca23c943ab87092a9544383677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:31:19.395001 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-63ff8a55-f0d7-4250-985a-5f286f928e0c tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e" status: 200 len: 1218 microversion: 2.1 time: 0.066193 Oct 01 04:31:19.395696 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 548/1064] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:31:19 2022] GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:31:20.418572 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-596dab14-5b6c-4ecf-b813-3d837dc81edd tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:31:20.419194 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-596dab14-5b6c-4ecf-b813-3d837dc81edd tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 72808e6d-f907-44b2-b094-27e432fb5e6e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:31:20.426394 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-596dab14-5b6c-4ecf-b813-3d837dc81edd tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:20.426871 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-596dab14-5b6c-4ecf-b813-3d837dc81edd tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:20.427318 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-596dab14-5b6c-4ecf-b813-3d837dc81edd tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:20.428020 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-596dab14-5b6c-4ecf-b813-3d837dc81edd tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:20.428515 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-596dab14-5b6c-4ecf-b813-3d837dc81edd tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:20.428970 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-596dab14-5b6c-4ecf-b813-3d837dc81edd tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:20.491826 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-596dab14-5b6c-4ecf-b813-3d837dc81edd tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27ccd9a0974420389d2216ca0590082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c8ca23c943ab87092a9544383677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:31:20.499824 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-596dab14-5b6c-4ecf-b813-3d837dc81edd tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e" status: 200 len: 1222 microversion: 2.1 time: 0.085171 Oct 01 04:31:20.500388 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 517/1065] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:31:20 2022] GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:31:21.523892 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-11846201-3e39-4ae1-936a-ab57f59d3b84 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:31:21.524516 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-11846201-3e39-4ae1-936a-ab57f59d3b84 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 72808e6d-f907-44b2-b094-27e432fb5e6e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:31:21.531844 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11846201-3e39-4ae1-936a-ab57f59d3b84 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:21.532337 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11846201-3e39-4ae1-936a-ab57f59d3b84 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:21.532778 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11846201-3e39-4ae1-936a-ab57f59d3b84 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:21.533519 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11846201-3e39-4ae1-936a-ab57f59d3b84 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:21.533980 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11846201-3e39-4ae1-936a-ab57f59d3b84 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:21.534412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-11846201-3e39-4ae1-936a-ab57f59d3b84 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:21.600892 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-11846201-3e39-4ae1-936a-ab57f59d3b84 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27ccd9a0974420389d2216ca0590082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c8ca23c943ab87092a9544383677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:31:21.617123 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-11846201-3e39-4ae1-936a-ab57f59d3b84 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e" status: 200 len: 1276 microversion: 2.1 time: 0.096944 Oct 01 04:31:21.617869 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 549/1066] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:31:21 2022] GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e => generated 1276 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:31:22.500623 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [req-028d06a1-ba8a-45b1-b715-ef6692dbd85c req-f831b956-57d5-4b6c-b19f-748b1aa0aefd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72808e6d-f907-44b2-b094-27e432fb5e6e", "tag": "8e7c3377-9d85-4d86-9c5e-24ad4a6f5c5e"}]} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:31:22.512157 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-028d06a1-ba8a-45b1-b715-ef6692dbd85c req-f831b956-57d5-4b6c-b19f-748b1aa0aefd service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:22.512756 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-028d06a1-ba8a-45b1-b715-ef6692dbd85c req-f831b956-57d5-4b6c-b19f-748b1aa0aefd service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:22.513278 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [req-028d06a1-ba8a-45b1-b715-ef6692dbd85c req-f831b956-57d5-4b6c-b19f-748b1aa0aefd service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:22.537067 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.compute.server_external_events [req-028d06a1-ba8a-45b1-b715-ef6692dbd85c req-f831b956-57d5-4b6c-b19f-748b1aa0aefd service nova] Creating event network-changed:8e7c3377-9d85-4d86-9c5e-24ad4a6f5c5e for instance 72808e6d-f907-44b2-b094-27e432fb5e6e on hv-cinder-86004 Oct 01 04:31:22.542243 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [req-028d06a1-ba8a-45b1-b715-ef6692dbd85c req-f831b956-57d5-4b6c-b19f-748b1aa0aefd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045659 Oct 01 04:31:22.542880 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 518/1067] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:31:22.639730 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-d8b09c5b-87d7-423f-aced-3074919a93c6 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:31:22.640340 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-d8b09c5b-87d7-423f-aced-3074919a93c6 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 72808e6d-f907-44b2-b094-27e432fb5e6e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:31:22.647000 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8b09c5b-87d7-423f-aced-3074919a93c6 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:22.647481 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8b09c5b-87d7-423f-aced-3074919a93c6 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:22.647912 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8b09c5b-87d7-423f-aced-3074919a93c6 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:22.648605 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8b09c5b-87d7-423f-aced-3074919a93c6 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:22.649083 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8b09c5b-87d7-423f-aced-3074919a93c6 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:22.649513 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-d8b09c5b-87d7-423f-aced-3074919a93c6 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:22.778620 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-d8b09c5b-87d7-423f-aced-3074919a93c6 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27ccd9a0974420389d2216ca0590082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c8ca23c943ab87092a9544383677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:31:22.786608 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-d8b09c5b-87d7-423f-aced-3074919a93c6 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e" status: 200 len: 1318 microversion: 2.1 time: 0.150856 Oct 01 04:31:22.787186 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 550/1068] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:31:22 2022] GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:31:23.811143 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-fca6382d-42fb-4690-92f7-dbb9c1a17830 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:31:23.811896 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-fca6382d-42fb-4690-92f7-dbb9c1a17830 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 72808e6d-f907-44b2-b094-27e432fb5e6e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:31:23.818012 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fca6382d-42fb-4690-92f7-dbb9c1a17830 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:23.818502 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fca6382d-42fb-4690-92f7-dbb9c1a17830 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:23.818936 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fca6382d-42fb-4690-92f7-dbb9c1a17830 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:23.819622 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fca6382d-42fb-4690-92f7-dbb9c1a17830 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:23.820081 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fca6382d-42fb-4690-92f7-dbb9c1a17830 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:23.820507 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-fca6382d-42fb-4690-92f7-dbb9c1a17830 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:23.955054 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-fca6382d-42fb-4690-92f7-dbb9c1a17830 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27ccd9a0974420389d2216ca0590082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c8ca23c943ab87092a9544383677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:31:23.962775 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-fca6382d-42fb-4690-92f7-dbb9c1a17830 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e" status: 200 len: 1318 microversion: 2.1 time: 0.156936 Oct 01 04:31:23.963559 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 519/1069] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:31:23 2022] GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:31:24.985771 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-47e5b965-22e1-494c-b3d5-f66d9eb3a3b4 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:31:24.986389 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-47e5b965-22e1-494c-b3d5-f66d9eb3a3b4 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 72808e6d-f907-44b2-b094-27e432fb5e6e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:31:24.992797 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47e5b965-22e1-494c-b3d5-f66d9eb3a3b4 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:24.993336 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47e5b965-22e1-494c-b3d5-f66d9eb3a3b4 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:24.993758 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47e5b965-22e1-494c-b3d5-f66d9eb3a3b4 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:24.994455 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47e5b965-22e1-494c-b3d5-f66d9eb3a3b4 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:24.994918 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47e5b965-22e1-494c-b3d5-f66d9eb3a3b4 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:24.995347 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-47e5b965-22e1-494c-b3d5-f66d9eb3a3b4 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:25.127102 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-47e5b965-22e1-494c-b3d5-f66d9eb3a3b4 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27ccd9a0974420389d2216ca0590082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c8ca23c943ab87092a9544383677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:31:25.134869 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-47e5b965-22e1-494c-b3d5-f66d9eb3a3b4 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e" status: 200 len: 1318 microversion: 2.1 time: 0.152979 Oct 01 04:31:25.135432 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 551/1070] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:31:24 2022] GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:31:26.160019 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-84ca275a-db89-4cea-b1c3-ed2795fbf68d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:31:26.160638 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-84ca275a-db89-4cea-b1c3-ed2795fbf68d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 72808e6d-f907-44b2-b094-27e432fb5e6e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:31:26.167185 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84ca275a-db89-4cea-b1c3-ed2795fbf68d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:26.167675 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84ca275a-db89-4cea-b1c3-ed2795fbf68d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:26.168117 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84ca275a-db89-4cea-b1c3-ed2795fbf68d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:26.168815 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84ca275a-db89-4cea-b1c3-ed2795fbf68d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:26.169308 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84ca275a-db89-4cea-b1c3-ed2795fbf68d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:26.169758 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-84ca275a-db89-4cea-b1c3-ed2795fbf68d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:26.297784 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-84ca275a-db89-4cea-b1c3-ed2795fbf68d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27ccd9a0974420389d2216ca0590082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c8ca23c943ab87092a9544383677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:31:26.305304 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-84ca275a-db89-4cea-b1c3-ed2795fbf68d tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e" status: 200 len: 1318 microversion: 2.1 time: 0.149192 Oct 01 04:31:26.305862 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 520/1071] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:31:26 2022] GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:31:26.731279 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-12bc5706-5055-4772-8858-86f018b42903 req-99b80fb0-8770-4581-9594-e897d255b42f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72808e6d-f907-44b2-b094-27e432fb5e6e", "name": "network-vif-plugged", "status": "completed", "tag": "8e7c3377-9d85-4d86-9c5e-24ad4a6f5c5e"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:31:26.740080 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=2 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:31:26.743026 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-12bc5706-5055-4772-8858-86f018b42903 req-99b80fb0-8770-4581-9594-e897d255b42f service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:26.743513 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-12bc5706-5055-4772-8858-86f018b42903 req-99b80fb0-8770-4581-9594-e897d255b42f service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:26.743945 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-12bc5706-5055-4772-8858-86f018b42903 req-99b80fb0-8770-4581-9594-e897d255b42f service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:26.756221 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-12bc5706-5055-4772-8858-86f018b42903 req-99b80fb0-8770-4581-9594-e897d255b42f service nova] Creating event network-vif-plugged:8e7c3377-9d85-4d86-9c5e-24ad4a6f5c5e for instance 72808e6d-f907-44b2-b094-27e432fb5e6e on hv-cinder-86004 Oct 01 04:31:26.761279 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-12bc5706-5055-4772-8858-86f018b42903 req-99b80fb0-8770-4581-9594-e897d255b42f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033709 Oct 01 04:31:26.761867 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 552/1072] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:31:27.327970 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-963bef59-403e-405e-8298-68ff64d52b1a tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:31:27.328530 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-963bef59-403e-405e-8298-68ff64d52b1a tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 72808e6d-f907-44b2-b094-27e432fb5e6e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:31:27.334941 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-963bef59-403e-405e-8298-68ff64d52b1a tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:27.335434 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-963bef59-403e-405e-8298-68ff64d52b1a tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:27.335877 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-963bef59-403e-405e-8298-68ff64d52b1a tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:27.336588 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-963bef59-403e-405e-8298-68ff64d52b1a tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:27.337081 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-963bef59-403e-405e-8298-68ff64d52b1a tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:27.337517 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-963bef59-403e-405e-8298-68ff64d52b1a tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:27.468953 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-963bef59-403e-405e-8298-68ff64d52b1a tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27ccd9a0974420389d2216ca0590082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c8ca23c943ab87092a9544383677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:31:27.476512 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-963bef59-403e-405e-8298-68ff64d52b1a tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e" status: 200 len: 1318 microversion: 2.1 time: 0.152510 Oct 01 04:31:27.477094 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 521/1073] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:31:27 2022] GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:31:28.502316 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-18f5db9e-ab1e-4817-a245-38e41c16f7ec tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:31:28.502957 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-18f5db9e-ab1e-4817-a245-38e41c16f7ec tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 72808e6d-f907-44b2-b094-27e432fb5e6e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:31:28.509448 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18f5db9e-ab1e-4817-a245-38e41c16f7ec tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:28.509946 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18f5db9e-ab1e-4817-a245-38e41c16f7ec tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:28.510388 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18f5db9e-ab1e-4817-a245-38e41c16f7ec tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:28.511097 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18f5db9e-ab1e-4817-a245-38e41c16f7ec tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:28.511561 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18f5db9e-ab1e-4817-a245-38e41c16f7ec tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:28.511991 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-18f5db9e-ab1e-4817-a245-38e41c16f7ec tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:28.644563 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-18f5db9e-ab1e-4817-a245-38e41c16f7ec tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27ccd9a0974420389d2216ca0590082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c8ca23c943ab87092a9544383677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:31:28.652424 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-18f5db9e-ab1e-4817-a245-38e41c16f7ec tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e" status: 200 len: 1507 microversion: 2.1 time: 0.156029 Oct 01 04:31:28.653065 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 553/1074] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:31:28 2022] GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e => generated 1507 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:31:28.675642 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-7272da97-8b37-42df-9292-dee9b57d8435 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dfaa8c74-0faa-41cd-931d-666fb9b6b612", "device": "/dev/sdb"}} {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:31:28.678541 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-7272da97-8b37-42df-9292-dee9b57d8435 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 72808e6d-f907-44b2-b094-27e432fb5e6e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:31:28.680495 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell0:SELECT=4 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:31:28.686787 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7272da97-8b37-42df-9292-dee9b57d8435 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:28.687282 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7272da97-8b37-42df-9292-dee9b57d8435 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:28.687727 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7272da97-8b37-42df-9292-dee9b57d8435 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:28.688435 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7272da97-8b37-42df-9292-dee9b57d8435 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:28.688904 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7272da97-8b37-42df-9292-dee9b57d8435 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:28.689358 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-7272da97-8b37-42df-9292-dee9b57d8435 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:28.922855 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-7272da97-8b37-42df-9292-dee9b57d8435 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "POST /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250953 Oct 01 04:31:28.923484 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 522/1075] 10.222.0.26 () {60 vars in 1323 bytes} [Sat Oct 1 04:31:28 2022] POST /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:31:46.219381 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-76a9078b-be0a-4737-9bf4-1aba32b5c262 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:31:46.219912 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-76a9078b-be0a-4737-9bf4-1aba32b5c262 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 72808e6d-f907-44b2-b094-27e432fb5e6e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:31:46.221888 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell0:SELECT=10 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:31:46.223504 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:31:46.224181 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG dbcounter [-] [120598] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120598) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:31:46.231412 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76a9078b-be0a-4737-9bf4-1aba32b5c262 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:46.232074 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76a9078b-be0a-4737-9bf4-1aba32b5c262 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:46.232521 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76a9078b-be0a-4737-9bf4-1aba32b5c262 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:46.234239 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76a9078b-be0a-4737-9bf4-1aba32b5c262 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:46.234924 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76a9078b-be0a-4737-9bf4-1aba32b5c262 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:46.235366 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-76a9078b-be0a-4737-9bf4-1aba32b5c262 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:46.323232 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.objects.instance [None req-76a9078b-be0a-4737-9bf4-1aba32b5c262 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lazy-loading 'services' on Instance uuid 72808e6d-f907-44b2-b094-27e432fb5e6e {{(pid=120598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:31:46.395731 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-76a9078b-be0a-4737-9bf4-1aba32b5c262 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "DELETE /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e/os-volume_attachments/dfaa8c74-0faa-41cd-931d-666fb9b6b612" status: 202 len: 0 microversion: 2.1 time: 0.180624 Oct 01 04:31:46.396323 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 554/1076] 10.222.0.26 () {58 vars in 1416 bytes} [Sat Oct 1 04:31:46 2022] DELETE /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e/os-volume_attachments/dfaa8c74-0faa-41cd-931d-666fb9b6b612 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 01 04:31:47.518220 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_api:SELECT=28 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:31:47.519320 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG dbcounter [-] [120597] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120597) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 01 04:31:47.523402 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-ccd9e4b8-a3c1-46a4-b256-4776d8e9957e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:31:47.524000 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ccd9e4b8-a3c1-46a4-b256-4776d8e9957e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 72808e6d-f907-44b2-b094-27e432fb5e6e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:31:47.531924 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ccd9e4b8-a3c1-46a4-b256-4776d8e9957e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:47.532418 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ccd9e4b8-a3c1-46a4-b256-4776d8e9957e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:47.532864 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ccd9e4b8-a3c1-46a4-b256-4776d8e9957e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:47.533593 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ccd9e4b8-a3c1-46a4-b256-4776d8e9957e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:47.534061 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ccd9e4b8-a3c1-46a4-b256-4776d8e9957e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:47.534494 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-ccd9e4b8-a3c1-46a4-b256-4776d8e9957e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:47.560597 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-ccd9e4b8-a3c1-46a4-b256-4776d8e9957e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 72808e6d-f907-44b2-b094-27e432fb5e6e] Going to try to terminate instance {{(pid=120597) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 01 04:31:47.635425 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-ccd9e4b8-a3c1-46a4-b256-4776d8e9957e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "DELETE /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e" status: 204 len: 0 microversion: 2.1 time: 0.118501 Oct 01 04:31:47.636330 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 523/1077] 10.222.0.26 () {58 vars in 1239 bytes} [Sat Oct 1 04:31:47 2022] DELETE /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 01 04:31:47.646186 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-09800c60-aa31-4d85-b1dc-99c0fbe3d41e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:31:47.646878 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-09800c60-aa31-4d85-b1dc-99c0fbe3d41e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 72808e6d-f907-44b2-b094-27e432fb5e6e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:31:47.653028 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09800c60-aa31-4d85-b1dc-99c0fbe3d41e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:47.653520 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09800c60-aa31-4d85-b1dc-99c0fbe3d41e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:47.653963 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09800c60-aa31-4d85-b1dc-99c0fbe3d41e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:47.654657 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09800c60-aa31-4d85-b1dc-99c0fbe3d41e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:47.655687 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09800c60-aa31-4d85-b1dc-99c0fbe3d41e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:47.656089 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-09800c60-aa31-4d85-b1dc-99c0fbe3d41e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:47.789540 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.policy [None req-09800c60-aa31-4d85-b1dc-99c0fbe3d41e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27ccd9a0974420389d2216ca0590082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c8ca23c943ab87092a9544383677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120598) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:31:47.797977 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-09800c60-aa31-4d85-b1dc-99c0fbe3d41e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e" status: 200 len: 1513 microversion: 2.1 time: 0.156725 Oct 01 04:31:47.798553 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 555/1078] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:31:47 2022] GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:31:48.821330 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-d522847c-7d33-4e5e-b1e3-efddc0f51e6e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:31:48.821955 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-d522847c-7d33-4e5e-b1e3-efddc0f51e6e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 72808e6d-f907-44b2-b094-27e432fb5e6e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:31:48.828583 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d522847c-7d33-4e5e-b1e3-efddc0f51e6e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:48.829109 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d522847c-7d33-4e5e-b1e3-efddc0f51e6e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:48.829551 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d522847c-7d33-4e5e-b1e3-efddc0f51e6e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:48.830250 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d522847c-7d33-4e5e-b1e3-efddc0f51e6e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:48.830714 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d522847c-7d33-4e5e-b1e3-efddc0f51e6e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:48.831142 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-d522847c-7d33-4e5e-b1e3-efddc0f51e6e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:48.966428 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-d522847c-7d33-4e5e-b1e3-efddc0f51e6e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27ccd9a0974420389d2216ca0590082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c8ca23c943ab87092a9544383677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:31:48.974698 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-d522847c-7d33-4e5e-b1e3-efddc0f51e6e tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e" status: 200 len: 1513 microversion: 2.1 time: 0.157672 Oct 01 04:31:48.975266 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 524/1079] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:31:48 2022] GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:31:49.661579 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [req-e12023c8-1b6f-4113-808b-8aff15913302 req-72646610-cf2e-485b-b7f6-c74489150b47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72808e6d-f907-44b2-b094-27e432fb5e6e", "name": "network-vif-deleted", "tag": "8e7c3377-9d85-4d86-9c5e-24ad4a6f5c5e"}]} {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 01 04:31:49.673542 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e12023c8-1b6f-4113-808b-8aff15913302 req-72646610-cf2e-485b-b7f6-c74489150b47 service nova] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:49.674051 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e12023c8-1b6f-4113-808b-8aff15913302 req-72646610-cf2e-485b-b7f6-c74489150b47 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:49.674487 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [req-e12023c8-1b6f-4113-808b-8aff15913302 req-72646610-cf2e-485b-b7f6-c74489150b47 service nova] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:49.686576 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.compute.server_external_events [req-e12023c8-1b6f-4113-808b-8aff15913302 req-72646610-cf2e-485b-b7f6-c74489150b47 service nova] Creating event network-vif-deleted:8e7c3377-9d85-4d86-9c5e-24ad4a6f5c5e for instance 72808e6d-f907-44b2-b094-27e432fb5e6e on hv-cinder-86004 Oct 01 04:31:49.693063 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [req-e12023c8-1b6f-4113-808b-8aff15913302 req-72646610-cf2e-485b-b7f6-c74489150b47 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035222 Oct 01 04:31:49.693554 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 556/1080] 10.222.0.26 () {64 vars in 1317 bytes} [Sat Oct 1 04:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 01 04:31:49.998620 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.api.openstack.wsgi [None req-bab1df0a-78fa-4413-aed8-35451a90955b tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:31:49.999334 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.compute.api [None req-bab1df0a-78fa-4413-aed8-35451a90955b tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 72808e6d-f907-44b2-b094-27e432fb5e6e] Fetching instance by UUID {{(pid=120597) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:31:50.005729 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bab1df0a-78fa-4413-aed8-35451a90955b tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:50.006221 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bab1df0a-78fa-4413-aed8-35451a90955b tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:50.006658 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bab1df0a-78fa-4413-aed8-35451a90955b tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:50.007348 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bab1df0a-78fa-4413-aed8-35451a90955b tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:50.007806 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bab1df0a-78fa-4413-aed8-35451a90955b tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:50.008231 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bab1df0a-78fa-4413-aed8-35451a90955b tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:50.041009 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bab1df0a-78fa-4413-aed8-35451a90955b tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:50.041504 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bab1df0a-78fa-4413-aed8-35451a90955b tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:50.041944 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG oslo_concurrency.lockutils [None req-bab1df0a-78fa-4413-aed8-35451a90955b tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120597) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:50.042396 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.objects.instance [None req-bab1df0a-78fa-4413-aed8-35451a90955b tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lazy-loading 'fault' on Instance uuid 72808e6d-f907-44b2-b094-27e432fb5e6e {{(pid=120597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 01 04:31:50.084097 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: DEBUG nova.policy [None req-bab1df0a-78fa-4413-aed8-35451a90955b tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e27ccd9a0974420389d2216ca0590082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c465c8ca23c943ab87092a9544383677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120597) authorize /opt/stack/nova/nova/policy.py:199}} Oct 01 04:31:50.091968 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: INFO nova.api.openstack.requestlog [None req-bab1df0a-78fa-4413-aed8-35451a90955b tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e" status: 200 len: 1308 microversion: 2.1 time: 0.097125 Oct 01 04:31:50.092720 dv-cinder-860044-1-iscsi devstack@n-api.service[120597]: [pid: 120597|app: 0|req: 525/1081] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:31:49 2022] GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 01 04:31:51.116364 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9947be3c-bfa8-45c2-9744-0bbf2764b454 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Calling method '>' {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 01 04:31:51.117088 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.compute.api [None req-9947be3c-bfa8-45c2-9744-0bbf2764b454 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] [instance: 72808e6d-f907-44b2-b094-27e432fb5e6e] Fetching instance by UUID {{(pid=120598) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 01 04:31:51.123189 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9947be3c-bfa8-45c2-9744-0bbf2764b454 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:51.123672 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9947be3c-bfa8-45c2-9744-0bbf2764b454 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:51.124105 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9947be3c-bfa8-45c2-9744-0bbf2764b454 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:51.125419 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9947be3c-bfa8-45c2-9744-0bbf2764b454 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Acquiring lock "6637a42c-607b-4146-a74a-010d94c4cfd5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 01 04:31:51.125875 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9947be3c-bfa8-45c2-9744-0bbf2764b454 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 01 04:31:51.126296 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG oslo_concurrency.lockutils [None req-9947be3c-bfa8-45c2-9744-0bbf2764b454 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Lock "6637a42c-607b-4146-a74a-010d94c4cfd5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120598) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 01 04:31:51.139284 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.wsgi [None req-9947be3c-bfa8-45c2-9744-0bbf2764b454 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] HTTP exception thrown: Instance 72808e6d-f907-44b2-b094-27e432fb5e6e could not be found. Oct 01 04:31:51.140880 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9947be3c-bfa8-45c2-9744-0bbf2764b454 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Request method failure captured: Oct 01 04:31:51.140880 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: request: GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e HTTP/1.1 Oct 01 04:31:51.140880 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept: application/json Oct 01 04:31:51.140880 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Accept-Encoding: identity Oct 01 04:31:51.140880 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Connection: close Oct 01 04:31:51.140880 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Length: 0 Oct 01 04:31:51.140880 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Content-Type: application/json Oct 01 04:31:51.140880 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Host: 10.222.0.26 Oct 01 04:31:51.140880 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: Openstack-System-Scope: None Oct 01 04:31:51.140880 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: User-Agent: python-urllib3/1.26.12 Oct 01 04:31:51.140880 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Auth-Token: gAAAAABjN8JW12Ytw6r6ZZPCYFNtcAjmRJQ8rkkQDjPpx-wJVYSC5E6f0RjW_4WbmUOQK31NFA9TyLFr7TzuTagI7VuqvNmbXtrNfYUybMDiQ3M8P7dTmB-0FuPvqOm-dHAtdIThYfPXivLBSroyUFmHt-DwUD2cZSr43RafKqFzcNNceTHAcfs Oct 01 04:31:51.140880 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Id: None Oct 01 04:31:51.140880 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Domain-Name: None Oct 01 04:31:51.140880 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Identity-Status: Confirmed Oct 01 04:31:51.140880 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Is-Admin-Project: True Oct 01 04:31:51.140880 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Id: default Oct 01 04:31:51.140880 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Domain-Name: Default Oct 01 04:31:51.140880 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Id: c465c8ca23c943ab87092a9544383677 Oct 01 04:31:51.140880 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Project-Name: tempest-VolumesSnapshotTestJSON-745650261 Oct 01 04:31:51.140880 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Role: reader,member Oct 01 04:31:51.140880 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Roles: reader,member Oct 01 04:31:51.142695 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c465c8ca23c943ab87092a9544383677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c465c8ca23c943ab87092a9544383677"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c465c8ca23c943ab87092a9544383677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c465c8ca23c943ab87092a9544383677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}] Oct 01 04:31:51.142695 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant: tempest-VolumesSnapshotTestJSON-745650261 Oct 01 04:31:51.142695 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Id: c465c8ca23c943ab87092a9544383677 Oct 01 04:31:51.142695 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-745650261 Oct 01 04:31:51.142695 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User: tempest-VolumesSnapshotTestJSON-745650261-project Oct 01 04:31:51.142695 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Id: default Oct 01 04:31:51.142695 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Domain-Name: Default Oct 01 04:31:51.142695 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Id: e27ccd9a0974420389d2216ca0590082 Oct 01 04:31:51.142695 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: X-User-Name: tempest-VolumesSnapshotTestJSON-745650261-project Oct 01 04:31:51.142695 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: method: > Oct 01 04:31:51.142695 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: exception: Instance 72808e6d-f907-44b2-b094-27e432fb5e6e could not be found. Oct 01 04:31:51.142695 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: action_args: {'id': '72808e6d-f907-44b2-b094-27e432fb5e6e'} Oct 01 04:31:51.144707 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: {{(pid=120598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 01 04:31:51.144707 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:31:51.144707 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 01 04:31:51.144707 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 01 04:31:51.144707 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 01 04:31:51.144707 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 01 04:31:51.144707 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 01 04:31:51.144707 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 01 04:31:51.144707 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 01 04:31:51.144707 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 01 04:31:51.144707 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72808e6d-f907-44b2-b094-27e432fb5e6e could not be found. Oct 01 04:31:51.144707 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:31:51.144707 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:31:51.144707 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:31:51.144707 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:31:51.144707 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:31:51.144707 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:31:51.144707 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 01 04:31:51.144707 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 01 04:31:51.144707 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 01 04:31:51.146346 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 01 04:31:51.146346 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 01 04:31:51.146346 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 01 04:31:51.146346 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 01 04:31:51.146346 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 01 04:31:51.146346 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 01 04:31:51.146346 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 01 04:31:51.146346 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72808e6d-f907-44b2-b094-27e432fb5e6e could not be found. Oct 01 04:31:51.146346 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:31:51.146346 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 01 04:31:51.146346 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:31:51.146346 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 01 04:31:51.146346 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 01 04:31:51.146346 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 01 04:31:51.146346 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 01 04:31:51.146346 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 01 04:31:51.146346 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72808e6d-f907-44b2-b094-27e432fb5e6e could not be found. Oct 01 04:31:51.146346 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: ERROR nova.api.openstack.wsgi Oct 01 04:31:51.147816 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: DEBUG nova.api.openstack.wsgi [None req-9947be3c-bfa8-45c2-9744-0bbf2764b454 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] Returning 404 to user: Instance 72808e6d-f907-44b2-b094-27e432fb5e6e could not be found. {{(pid=120598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 01 04:31:51.147816 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: INFO nova.api.openstack.requestlog [None req-9947be3c-bfa8-45c2-9744-0bbf2764b454 tempest-VolumesSnapshotTestJSON-745650261 tempest-VolumesSnapshotTestJSON-745650261-project] 10.222.0.26 "GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e" status: 404 len: 111 microversion: 2.1 time: 0.030562 Oct 01 04:31:51.147816 dv-cinder-860044-1-iscsi devstack@n-api.service[120598]: [pid: 120598|app: 0|req: 557/1082] 10.222.0.26 () {58 vars in 1236 bytes} [Sat Oct 1 04:31:51 2022] GET /compute/v2.1/servers/72808e6d-f907-44b2-b094-27e432fb5e6e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)